-- Logs begin at Tue 2022-05-10 01:38:18 UTC, end at Tue 2022-05-10 03:33:30 UTC. -- May 10 03:09:42.120931 dv-cinder-830094-4-smb systemd[1]: Starting Devstack devstack@n-api.service... May 10 03:09:42.129737 dv-cinder-830094-4-smb devstack@n-api.service[103051]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 03:09:42.131728 dv-cinder-830094-4-smb devstack@n-api.service[103051]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 03:09:42 2022] *** May 10 03:09:42.131728 dv-cinder-830094-4-smb devstack@n-api.service[103051]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 03:09:42.131728 dv-cinder-830094-4-smb devstack@n-api.service[103051]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 03:09:42.131728 dv-cinder-830094-4-smb devstack@n-api.service[103051]: nodename: dv-cinder-830094-4-smb May 10 03:09:42.131728 dv-cinder-830094-4-smb devstack@n-api.service[103051]: machine: x86_64 May 10 03:09:42.131728 dv-cinder-830094-4-smb devstack@n-api.service[103051]: clock source: unix May 10 03:09:42.131728 dv-cinder-830094-4-smb devstack@n-api.service[103051]: pcre jit disabled May 10 03:09:42.131728 dv-cinder-830094-4-smb devstack@n-api.service[103051]: detected number of CPU cores: 4 May 10 03:09:42.131728 dv-cinder-830094-4-smb devstack@n-api.service[103051]: current working directory: / May 10 03:09:42.131728 dv-cinder-830094-4-smb devstack@n-api.service[103051]: detected binary path: /usr/bin/uwsgi-core May 10 03:09:42.132444 dv-cinder-830094-4-smb devstack@n-api.service[103051]: your processes number limit is 47680 May 10 03:09:42.132444 dv-cinder-830094-4-smb devstack@n-api.service[103051]: your memory page size is 4096 bytes May 10 03:09:42.132444 dv-cinder-830094-4-smb devstack@n-api.service[103051]: detected max file descriptor number: 2048 May 10 03:09:42.132444 dv-cinder-830094-4-smb devstack@n-api.service[103051]: lock engine: pthread robust mutexes May 10 03:09:42.132444 dv-cinder-830094-4-smb devstack@n-api.service[103051]: thunder lock: enabled May 10 03:09:42.132444 dv-cinder-830094-4-smb devstack@n-api.service[103051]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 03:09:42.132444 dv-cinder-830094-4-smb devstack@n-api.service[103051]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 03:09:42.178454 dv-cinder-830094-4-smb devstack@n-api.service[103051]: Python main interpreter initialized at 0x55d6230b89c0 May 10 03:09:42.178454 dv-cinder-830094-4-smb devstack@n-api.service[103051]: python threads support enabled May 10 03:09:42.178454 dv-cinder-830094-4-smb devstack@n-api.service[103051]: your server socket listen backlog is limited to 100 connections May 10 03:09:42.178454 dv-cinder-830094-4-smb devstack@n-api.service[103051]: your mercy for graceful operations on workers is 90 seconds May 10 03:09:42.178817 dv-cinder-830094-4-smb devstack@n-api.service[103051]: mapped 403077 bytes (393 KB) for 2 cores May 10 03:09:42.178892 dv-cinder-830094-4-smb devstack@n-api.service[103051]: *** Operational MODE: preforking *** May 10 03:09:42.179121 dv-cinder-830094-4-smb devstack@n-api.service[103051]: *** uWSGI is running in multiple interpreter mode *** May 10 03:09:42.179121 dv-cinder-830094-4-smb devstack@n-api.service[103051]: spawned uWSGI master process (pid: 103051) May 10 03:09:42.179319 dv-cinder-830094-4-smb systemd[1]: Started Devstack devstack@n-api.service. May 10 03:09:42.180714 dv-cinder-830094-4-smb devstack@n-api.service[103051]: spawned uWSGI worker 1 (pid: 103052, cores: 1) May 10 03:09:42.180714 dv-cinder-830094-4-smb devstack@n-api.service[103051]: spawned uWSGI worker 2 (pid: 103053, cores: 1) May 10 03:09:42.180714 dv-cinder-830094-4-smb devstack@n-api.service[103051]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 03:09:43.375569 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 03:09:43.384405 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 03:09:44.106553 dv-cinder-830094-4-smb devstack@n-api.service[103052]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 03:09:44.106553 dv-cinder-830094-4-smb devstack@n-api.service[103052]: from cryptography.utils import int_from_bytes May 10 03:09:44.106857 dv-cinder-830094-4-smb devstack@n-api.service[103053]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 03:09:44.106857 dv-cinder-830094-4-smb devstack@n-api.service[103053]: from cryptography.utils import int_from_bytes May 10 03:09:44.106977 dv-cinder-830094-4-smb devstack@n-api.service[103052]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 03:09:44.106977 dv-cinder-830094-4-smb devstack@n-api.service[103052]: from cryptography.utils import int_from_bytes May 10 03:09:44.107118 dv-cinder-830094-4-smb devstack@n-api.service[103053]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 03:09:44.107118 dv-cinder-830094-4-smb devstack@n-api.service[103053]: from cryptography.utils import int_from_bytes May 10 03:09:46.699048 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 03:09:46.699611 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 03:09:46.699822 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 03:09:46.700215 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 03:09:46.700340 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 03:09:46.700714 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 03:09:46.700808 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 03:09:46.700895 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.700985 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 03:09:46.701169 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.701342 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 03:09:46.701494 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.701606 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 03:09:46.701819 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.701998 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.702151 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.702328 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.702463 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.702696 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.702795 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.702974 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.703095 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.703310 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.703425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.703630 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.703727 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.703954 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.704073 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.704313 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.704405 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830094-4-smb {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.704639 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.704777 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.704901 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.704992 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.705217 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.705307 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.705547 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830094-4-smb {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.705641 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.705853 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.705942 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.706168 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.706261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.706479 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.706575 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.706795 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.706988 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.707089 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.707414 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.707536 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.707722 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.707841 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.708058 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.708261 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.708462 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.708580 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.708690 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.708868 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.709014 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.709182 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.709328 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.709517 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.709624 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.709833 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.709948 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.710146 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.710245 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.710467 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.710639 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830094-4-smb {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.710778 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.710958 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.711103 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.711273 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.711412 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.711588 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.711807 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830094-4-smb {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.712012 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.712151 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.712336 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.712468 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.712648 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.712784 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.712971 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.713199 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.713294 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.713511 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.713599 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.713825 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.713965 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.714175 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.714268 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.714502 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.714594 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.714811 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.714900 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.715141 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.715230 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.715453 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.715536 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.715766 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.715862 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.716109 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.716198 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.716416 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.716500 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.716721 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.716818 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.716976 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.717068 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.717282 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.717373 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.717604 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.717701 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.717919 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.718004 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.718172 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.718263 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.718479 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.718566 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.718731 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.718825 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.719053 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.719144 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.719374 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.719461 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.719662 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.719755 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.719913 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.720026 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.720258 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.720353 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.720578 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.720663 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.720887 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.720982 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.721193 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.721283 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.721498 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.721582 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.721801 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.721893 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.722104 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.722197 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.722409 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.722493 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.722714 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.722806 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.723018 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.723102 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.723337 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.723429 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.723653 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.723743 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.723975 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.724148 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.724307 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.724402 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.724628 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.724714 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.724954 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.725042 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.725263 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.725350 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.725569 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.725653 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.725893 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.725977 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.726202 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.726297 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.726508 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.726600 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.726815 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.726908 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.727133 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.727225 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.727441 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.727526 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.727747 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.727831 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.727997 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.728111 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.728322 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.728415 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.728628 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.728712 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.728949 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.729047 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.729232 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.729316 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.729536 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.729630 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.730373 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.730467 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.730678 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.730763 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.730983 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.731077 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.731288 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.731382 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.731590 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.731681 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.731891 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.731982 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.732221 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.732316 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.732525 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.732609 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.732830 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.732921 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.733132 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.733217 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.733437 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.733527 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.733741 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.733871 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.734051 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.734180 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.734354 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.734438 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.734656 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.734751 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.734958 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.735050 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.735263 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.735357 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.735575 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.735664 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.735877 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.735973 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.736208 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.736307 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.736516 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.736602 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.736827 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.736912 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.737131 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.737220 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.737436 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.737533 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.737740 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.737825 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.738046 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.738132 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.738348 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.738440 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.738651 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.738735 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.738956 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.739042 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.739261 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.739361 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.739563 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.739653 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.739866 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.739949 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.740194 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.740360 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.740501 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.740596 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.740804 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.740900 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.741108 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.741206 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.741407 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.741491 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.741709 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.741798 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.742007 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.742091 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.742309 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.742392 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.742611 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.742696 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.742913 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.742999 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.743214 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.743299 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.743517 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.743600 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.743834 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.743935 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.744168 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.744299 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.744476 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.744572 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.744780 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.744869 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.745100 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:09:46.745184 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.746000 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.746115 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.746349 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.746436 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.746682 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.746765 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.747000 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.747095 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.747312 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.747395 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.747641 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.747725 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.747952 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.748068 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.748292 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.748377 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.748605 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.748689 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.748924 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.749009 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.749235 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.749327 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.749551 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.749643 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.749864 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.749970 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.750180 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.750271 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.750495 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.750579 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.750804 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.750900 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.751123 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.751208 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.751440 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.751530 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.751761 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.751847 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.752100 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.752188 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.752420 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.752512 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.752753 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.752840 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.753077 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.753169 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.753390 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.753476 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.753714 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.753807 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.754030 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.754124 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.754345 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.754439 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.754658 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.754744 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.754982 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.755066 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.755312 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.755403 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.755625 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.755712 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.755939 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.756043 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.756282 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.756376 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.756598 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.756691 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.756917 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.757002 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.757229 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.757330 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.757541 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.757633 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.757857 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.757943 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.758170 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.758267 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.758485 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.758570 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.758796 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.758878 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.759117 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.759211 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.759429 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.759514 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.759741 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.759826 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.760077 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.760168 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.760388 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.760483 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.760697 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.760788 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.761031 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.761117 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.761344 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.761427 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.761650 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.761739 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.761956 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.762048 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.762264 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.762352 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.762578 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.762665 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.762886 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.762972 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.763206 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.763289 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.763521 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.763679 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.763828 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.763912 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.764163 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.764263 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.764475 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.764573 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.764790 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.764875 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.765102 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.765185 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.765409 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.765504 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.765715 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.765801 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.766030 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.766114 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.766336 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.766428 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.766642 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.766733 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.766963 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.767046 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.767272 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.767365 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.767577 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.767668 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.767888 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.767972 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.768224 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.768310 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.768532 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.768617 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.768840 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.768930 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.769152 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.769237 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.769465 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.769549 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.769775 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.769867 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.770087 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.770174 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.770414 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.770507 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.770721 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.770813 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.771033 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.771117 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.771360 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.771450 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.771681 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.771781 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.771988 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.772143 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.772324 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.772408 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.772631 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.772725 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.772940 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.773025 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.773248 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.773332 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.773559 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.773644 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.773864 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.773947 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.774170 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.774260 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.774477 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.774604 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.774781 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.774865 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.775086 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.775169 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.775393 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.775479 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.775700 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.775785 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.776047 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.776134 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.776340 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.776425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.776671 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.776754 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.776993 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.777086 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.777300 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.777391 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.777606 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.777690 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.777913 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.778013 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.778262 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.778347 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.778569 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.778653 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.778885 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.778982 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.779204 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.779299 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.779518 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.779610 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.779832 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.779925 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.780169 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.780267 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.780485 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.780570 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.780798 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.780927 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.781108 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.781192 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.781419 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.781504 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.781730 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.781823 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.782050 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.782135 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.782360 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.782445 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.782681 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.782847 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.782987 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.783073 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.783305 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.783389 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.783616 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.783708 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.783939 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.784059 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.784280 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.784365 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.784602 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.784689 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.784914 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.784999 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.785233 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.785331 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.785547 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.785633 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.785864 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.785960 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.786177 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.786273 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.786492 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.786584 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.786803 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.786887 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.787115 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.787209 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.787430 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.787522 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.787740 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.787823 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.788078 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.788178 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.788392 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.788477 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.788711 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.788801 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.789272 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.789369 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.789588 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.789673 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.789898 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.789993 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.790218 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.790305 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.790525 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.790609 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.790838 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.790928 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.791162 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.791249 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.791477 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.791563 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.791789 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.791881 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.792129 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.792701 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.792955 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.793038 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.793265 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.793351 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.793578 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.793666 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.793891 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.793975 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.794199 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.794292 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.794506 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.794590 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.794811 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.794894 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.795126 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.795219 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.795434 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.795561 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.795742 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.795879 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.796075 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.796218 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.796389 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.796490 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.796699 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.796812 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.797005 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.797120 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.797309 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.797407 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.797621 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.797725 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.797934 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.798030 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.798241 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.798344 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.798563 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.798658 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.798874 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.798971 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.799179 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.799275 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.799483 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.799578 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.799788 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.799885 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.800129 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.800226 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.800439 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.800536 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.800746 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.800843 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.801052 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.801148 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.801372 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.801476 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.801683 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.801779 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.801989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.802084 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.802297 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.802403 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.802607 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.802703 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.802926 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.803054 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.803239 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.803350 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.803548 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.803641 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.803858 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.803943 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.804195 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.804296 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.804506 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.804600 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.804818 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.804948 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.805131 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.805224 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.805438 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.805529 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.805748 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.805839 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.806055 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.806156 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.806363 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.806467 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.806669 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.806761 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.806980 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.807065 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.807295 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.807551 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.807636 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.808457 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.808567 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.808778 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.808863 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.809098 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.809355 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.809460 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.809679 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.809773 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.809999 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.810083 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.810322 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.810419 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.810644 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.810730 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.810965 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.811063 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.811278 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.811361 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.811586 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.811672 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.811892 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.811977 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.812230 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.812325 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.812538 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.812631 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.812843 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.812928 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.813149 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.813236 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.813459 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.813555 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.813765 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.813858 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.814069 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.814155 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.814371 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.814464 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.814680 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.814764 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.814985 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.815070 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.815289 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.815385 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.815595 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.815686 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.815898 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.815983 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.816239 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.816326 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.816549 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.816644 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.816850 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.816934 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.817155 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.817241 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.817461 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.817553 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.817777 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.817874 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.818084 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.818178 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.818391 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.818476 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.818698 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.818790 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.819045 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.819140 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.819351 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.819436 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.819659 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.819751 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.819988 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.820094 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.820318 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.820403 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.820626 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.820722 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.820931 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.821023 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.821246 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.821331 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.821557 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.821650 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.821863 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.821958 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.822173 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.822264 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.822482 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.822574 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.822792 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.822876 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.823099 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.823188 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.823403 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.823498 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.823739 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.823823 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.824063 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.824152 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.824383 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.824470 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.824692 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.824782 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.824994 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.825122 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.825298 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.825383 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.825608 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.825692 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.825916 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.825999 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.826219 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.826304 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.826523 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.826606 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.826824 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.826916 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.827134 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.827220 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.827440 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.827526 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.827744 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.827836 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.828065 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.828151 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.828378 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.828470 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.828683 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.828777 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.828989 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.829072 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.829293 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.829384 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.829605 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.829699 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.829908 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.829992 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.830213 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.830297 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.830522 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.830607 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.830826 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.830912 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.831131 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.831224 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.831436 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.831522 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.831748 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.831832 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.832075 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.832167 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.832386 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.832473 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.832697 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.832789 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.833025 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.833111 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.833333 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.833418 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.833637 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.833729 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.833943 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.834040 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.834247 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.834332 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.834550 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.834634 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.834851 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.834952 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.835155 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.835241 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.835458 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.835542 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.835765 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.835860 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.836095 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.836184 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.836399 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.836483 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.836704 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.836804 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.837004 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.837096 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.837329 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.837415 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.837635 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.837728 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.837943 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.838027 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.838249 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.838335 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.838587 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.838672 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.838891 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.838980 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.839236 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.839329 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.839551 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.839637 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.839867 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.839958 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.840212 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.840299 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.840526 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.840610 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.841092 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.841188 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.841188 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.841338 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.841426 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.841505 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.841735 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.841820 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.842045 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.842137 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.842360 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.842450 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.842667 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.842750 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.842975 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.843068 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.843301 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.843386 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.843615 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.843699 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.843921 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.844038 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.844271 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.844356 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.844585 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.844679 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.844896 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.844991 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.845209 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.845350 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.845521 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.845612 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.845832 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.845918 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.846142 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.846225 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.846453 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.846537 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.846766 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.846854 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.847077 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.847163 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.847391 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.847476 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.847701 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.847786 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.848055 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.848160 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.848341 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.848426 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.848651 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.848736 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.848964 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.849049 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.849268 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.849360 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.849581 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.849674 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.849887 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.849971 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.850197 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.850291 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.850504 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.850588 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.850819 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.850940 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.851127 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.851255 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.851439 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.851567 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.851747 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.851874 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.852199 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.852301 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.852516 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.852601 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.852830 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.852914 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.853137 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.853222 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.853443 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.853526 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.853753 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.853845 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.854070 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.854163 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.854388 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.854472 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.855209 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.855301 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.855578 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.855663 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.855885 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.855970 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.856222 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.856318 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.856554 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.856641 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.856862 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.856946 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.857166 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.857258 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.857471 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.857556 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.857797 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.857882 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.858100 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.858193 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.858406 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.858497 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.858713 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.858830 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.859039 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.859133 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.859347 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.859432 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.859671 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.859844 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.860118 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.860219 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.860437 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.860523 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.860748 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.860833 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.861108 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.861194 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.861435 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.861521 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.861743 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.861835 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.862058 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.862145 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.862370 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.862475 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.862697 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.862791 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.863003 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.863089 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.863320 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.863413 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.863633 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.863717 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.863939 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.864038 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.864292 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.864386 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.864611 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.864697 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.864926 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.865019 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.865239 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.865324 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.865565 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.865653 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.865890 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.865984 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.866208 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.866293 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.866535 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.866620 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.866884 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.867027 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.867192 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.867278 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.867499 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.867583 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.867817 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.867911 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.868153 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.868243 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.868474 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.868570 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.868803 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.868897 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.869112 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.869204 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.869418 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.869502 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.869725 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.869818 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.870032 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.870117 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.870393 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.871023 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.871208 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.871296 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.871521 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.871613 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.871833 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.871916 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.872163 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.872251 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.872472 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.872569 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.872802 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.872886 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.873109 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.873194 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.873421 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.873505 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.873748 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.873846 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.874061 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.874148 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.874369 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.874454 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.874675 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.874773 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.874980 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.875065 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.875307 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.875399 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.875616 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.875711 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.875924 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.876052 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.876259 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.876345 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.876599 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.876695 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.876905 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.876989 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.877231 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.877317 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.877565 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.877651 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.877889 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.878012 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.878204 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.878287 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.878530 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.878617 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.878838 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.878931 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.879145 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.879230 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.879458 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.879544 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.879763 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.879849 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.880092 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.880194 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.880401 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.880487 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.880712 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.880804 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.881018 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.881111 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.881323 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.881408 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.881625 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.881710 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.881936 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.882033 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.882242 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.882326 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.882547 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.882631 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.882852 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.882951 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.883156 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.883240 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.883461 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.883547 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.883766 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.883860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.884104 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.884193 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.884413 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.884499 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.884721 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.884821 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.885026 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.885119 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.885366 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.885451 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.885671 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.885757 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.886034 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.886125 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.886369 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.886463 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.886729 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.886819 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.887049 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.887135 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.887369 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.887455 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.887689 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.887784 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.888028 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.888117 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.888349 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.888447 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.888665 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.888749 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.888975 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.889061 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.889291 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.889384 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.889606 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.889689 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.889920 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.890005 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.890232 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.890451 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.890538 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.890782 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.890875 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.891101 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.891187 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.891416 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.891673 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.891768 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.892024 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.892113 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.892344 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.892438 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.892660 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.892745 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.892971 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.893056 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.893282 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.893377 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.893594 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.893682 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.893908 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.893993 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.894222 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.894310 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.894535 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.894628 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.894849 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.895009 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.895180 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.895266 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.895496 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.895582 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.895813 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.895912 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.896157 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.896248 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.896486 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.896571 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.896805 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.896892 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.897115 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.897199 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.897432 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.897516 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.897751 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.897843 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.898067 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.898154 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.898380 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.898475 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.898691 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.898777 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.899005 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.899095 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.899321 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.899415 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.899632 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.899721 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.899944 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.900063 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.900285 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.900381 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.900601 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.900687 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.900914 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.901000 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.901228 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.901316 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.901546 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.901632 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.901888 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.901975 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.902205 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.902292 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.902525 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.902611 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.902849 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.903049 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.903166 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.903368 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.903484 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.903708 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.903796 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.904057 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.904347 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.904443 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.904666 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.904759 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.905003 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.905097 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.905331 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.905422 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.905651 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.905738 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.905962 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.906062 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.906276 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.906369 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.906588 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.906674 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.906897 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.906992 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.907202 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.907288 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.907516 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.907604 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.907827 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.907921 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.908158 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.908246 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.908476 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.908562 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.908787 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.909012 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.909097 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.909360 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.909497 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.909680 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.909779 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.910012 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.910235 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.910341 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.910590 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.910684 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.910915 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.911002 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.911250 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.911336 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.911569 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.911662 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.911879 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.911964 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.912219 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.912305 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.912532 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.912627 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.912842 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.912928 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.913150 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.913244 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.913466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.913565 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.913778 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.913863 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.914340 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.914479 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.914650 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.914743 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.914956 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.915042 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.915272 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.915360 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.915581 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.915668 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.915888 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.915973 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.916220 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.916307 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.916533 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.916619 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.916840 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.916934 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.917147 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.917736 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.917987 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.918073 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.918300 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.918385 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.918614 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.918700 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.918921 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.919006 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.919229 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.919314 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.919534 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.919626 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.919845 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.919937 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.920175 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.920262 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.920486 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.920583 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.920793 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.920884 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.921106 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.921193 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.921413 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.921509 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.921725 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.921811 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.922046 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.922130 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.922358 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.922451 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.922683 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.922768 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.922986 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.923078 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.923295 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.923387 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.923608 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.923694 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.923934 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.924065 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.924276 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.924495 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.924591 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.924831 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.924917 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.925152 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.925247 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.925487 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.925755 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.925841 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.926098 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.926184 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.926408 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.926493 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.926716 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.926803 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.927043 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.927136 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.927354 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.927440 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.927666 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.927750 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.927975 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.928132 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.928318 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.928394 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.928628 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.928714 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.928938 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.929032 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.929250 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.929343 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.929562 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.929646 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.929870 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.929963 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.930181 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.930266 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.930489 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.930574 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.930800 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.930886 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.931112 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.931197 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.931423 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.931508 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.931734 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.931821 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.932068 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.932158 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.932390 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.932476 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.932708 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.932802 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.933563 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.933658 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.933876 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.933971 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.934189 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.934274 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.934513 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.934639 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.934826 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.934919 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.935140 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.935228 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.935452 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.935545 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.935759 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.935852 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.936106 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.936194 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.936443 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.936529 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.936759 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.936847 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.937069 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.937155 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.937439 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.937523 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.937766 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.937852 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.938091 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.938177 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.938410 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.938497 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.938724 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.938809 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.939039 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.939123 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.939364 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.939458 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.939679 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.939764 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.940027 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.940116 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.940335 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.940434 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.940650 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.940735 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.940958 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.941044 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.941274 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.941367 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.941589 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.941675 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.941911 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.942003 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.942219 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.942304 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.942526 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.942611 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.942833 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.942926 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.943147 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.943234 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.943454 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.943540 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.943760 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.943853 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.944089 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.944197 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.944399 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.944491 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.944704 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.944788 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.945009 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.945095 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.945314 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.945399 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.945619 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.945713 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.945925 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.946011 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.946229 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.946352 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.946535 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.946627 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.946838 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.946930 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.947143 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.947227 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.947444 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.947540 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.947748 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.947840 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.948077 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.948165 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.948385 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.948483 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.948731 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.948825 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.949037 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.949132 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.949344 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.949430 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.949648 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.949734 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.949984 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.950069 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.950306 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.950392 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.950617 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.950702 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.950941 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.951025 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.951256 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.951342 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.951571 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.951656 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.951882 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.951966 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.952232 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.952328 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.952544 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.952628 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.952900 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.953002 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.953168 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.953253 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.953478 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.953562 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.953788 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.953883 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.954099 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.954184 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.954412 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.954497 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.954725 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.954857 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.955037 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.955123 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.955350 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.955436 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.955667 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.955760 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.955993 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.956098 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.956326 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.956409 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.956637 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.956724 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.956963 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.957056 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.957275 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.957359 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.957588 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.957683 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.957900 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.958004 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.958212 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.958309 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.958530 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.958653 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.958842 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.958925 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.959158 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.959251 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.959470 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.959554 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.959785 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.959877 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.960129 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.960233 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.960449 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.960535 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.960780 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.960866 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.961103 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.961199 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.961432 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.961562 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.961764 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.961850 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.962080 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.962167 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.962395 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.962481 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.962705 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.962790 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.962950 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 03:09:46.963063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.963383 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.963698 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.964040 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:09:46.964297 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103053) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 03:09:46.986247 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_db.sqlalchemy.engines [None req-d896e421-a009-4bec-8e88-368bb22410d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103052) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:09:46.987878 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG oslo_db.sqlalchemy.engines [None req-7b43b0e2-24c1-4078-9832-dd1c66976ea0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103053) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:09:47.050290 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.context [None req-d896e421-a009-4bec-8e88-368bb22410d6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e40af967-83ea-437d-8987-bd41fe271b3a(cell1) {{(pid=103052) load_cells /opt/stack/nova/nova/context.py:464}} May 10 03:09:47.053057 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.context [None req-7b43b0e2-24c1-4078-9832-dd1c66976ea0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e40af967-83ea-437d-8987-bd41fe271b3a(cell1) {{(pid=103053) load_cells /opt/stack/nova/nova/context.py:464}} May 10 03:09:47.054631 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_concurrency.lockutils [None req-d896e421-a009-4bec-8e88-368bb22410d6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:47.056228 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_concurrency.lockutils [None req-d896e421-a009-4bec-8e88-368bb22410d6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:47.057022 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_concurrency.lockutils [None req-d896e421-a009-4bec-8e88-368bb22410d6 None None] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:47.057352 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG oslo_concurrency.lockutils [None req-7b43b0e2-24c1-4078-9832-dd1c66976ea0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:47.058964 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG oslo_concurrency.lockutils [None req-7b43b0e2-24c1-4078-9832-dd1c66976ea0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:47.059067 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_concurrency.lockutils [None req-d896e421-a009-4bec-8e88-368bb22410d6 None None] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:47.059789 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG oslo_concurrency.lockutils [None req-7b43b0e2-24c1-4078-9832-dd1c66976ea0 None None] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:09:47.061757 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG oslo_concurrency.lockutils [None req-7b43b0e2-24c1-4078-9832-dd1c66976ea0 None None] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103053) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:09:47.070052 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_db.sqlalchemy.engines [None req-d896e421-a009-4bec-8e88-368bb22410d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103052) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:09:47.073831 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_db.sqlalchemy.engines [None req-d896e421-a009-4bec-8e88-368bb22410d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103052) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:09:47.077264 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG oslo_db.sqlalchemy.engines [None req-7b43b0e2-24c1-4078-9832-dd1c66976ea0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103053) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:09:47.080546 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG oslo_db.sqlalchemy.engines [None req-7b43b0e2-24c1-4078-9832-dd1c66976ea0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103053) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:09:47.241096 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_db.sqlalchemy.engines [None req-d896e421-a009-4bec-8e88-368bb22410d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103052) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:09:47.247807 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG oslo_db.sqlalchemy.engines [None req-7b43b0e2-24c1-4078-9832-dd1c66976ea0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103053) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:09:47.668412 dv-cinder-830094-4-smb devstack@n-api.service[103052]: WARNING keystonemiddleware.auth_token [None req-d896e421-a009-4bec-8e88-368bb22410d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 03:09:47.675758 dv-cinder-830094-4-smb devstack@n-api.service[103052]: WARNING keystonemiddleware.auth_token [None req-d896e421-a009-4bec-8e88-368bb22410d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 03:09:47.713081 dv-cinder-830094-4-smb devstack@n-api.service[103053]: WARNING keystonemiddleware.auth_token [None req-7b43b0e2-24c1-4078-9832-dd1c66976ea0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 03:09:47.721068 dv-cinder-830094-4-smb devstack@n-api.service[103053]: WARNING keystonemiddleware.auth_token [None req-7b43b0e2-24c1-4078-9832-dd1c66976ea0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 03:09:48.016603 dv-cinder-830094-4-smb devstack@n-api.service[103052]: WARNING keystonemiddleware.auth_token [None req-d896e421-a009-4bec-8e88-368bb22410d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 03:09:48.022633 dv-cinder-830094-4-smb devstack@n-api.service[103052]: WARNING keystonemiddleware.auth_token [None req-d896e421-a009-4bec-8e88-368bb22410d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 03:09:48.028669 dv-cinder-830094-4-smb devstack@n-api.service[103052]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d6230b89c0 pid: 103052 (default app) May 10 03:09:48.030713 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-d896e421-a009-4bec-8e88-368bb22410d6 None None] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:09:48.031890 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-d896e421-a009-4bec-8e88-368bb22410d6 None None] 10.222.0.65 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001725 May 10 03:09:48.032329 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 788 bytes} [Tue May 10 03:09:48 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:09:48.065351 dv-cinder-830094-4-smb devstack@n-api.service[103053]: WARNING keystonemiddleware.auth_token [None req-7b43b0e2-24c1-4078-9832-dd1c66976ea0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 03:09:48.071457 dv-cinder-830094-4-smb devstack@n-api.service[103053]: WARNING keystonemiddleware.auth_token [None req-7b43b0e2-24c1-4078-9832-dd1c66976ea0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 03:09:48.078134 dv-cinder-830094-4-smb devstack@n-api.service[103053]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d6230b89c0 pid: 103053 (default app) May 10 03:11:08.661843 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-d896e421-a009-4bec-8e88-368bb22410d6 None None] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:08.662897 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-d896e421-a009-4bec-8e88-368bb22410d6 None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 10 03:11:08.663330 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 2/2] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 03:11:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:11:09.078533 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-4de5c8d3-ce57-4c1f-a1ff-b2ec6fc579d9 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:09.107612 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-4de5c8d3-ce57-4c1f-a1ff-b2ec6fc579d9 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.437018 May 10 03:11:09.108373 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 1/3] 10.222.0.65 () {60 vars in 1291 bytes} [Tue May 10 03:11:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:11:11.396147 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-d896e421-a009-4bec-8e88-368bb22410d6 None None] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:11.397143 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-d896e421-a009-4bec-8e88-368bb22410d6 None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 10 03:11:11.397799 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 3/4] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 03:11:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:11:11.465366 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-cf13421c-1377-408f-a8d4-3ccf3e5793f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "name": "cirros256", "disk": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:11.484965 dv-cinder-830094-4-smb devstack@n-api.service[103053]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:11:11.484965 dv-cinder-830094-4-smb devstack@n-api.service[103053]: warnings.warn(msg) May 10 03:11:11.602430 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-cf13421c-1377-408f-a8d4-3ccf3e5793f2 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.198412 May 10 03:11:11.602992 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 2/5] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 10 03:11:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:11:11.822032 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-e3fe51d8-329c-4bb4-b6bc-816d0a13d991 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:11.824512 dv-cinder-830094-4-smb devstack@n-api.service[103052]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:11:11.824512 dv-cinder-830094-4-smb devstack@n-api.service[103052]: warnings.warn(msg) May 10 03:11:11.934404 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-e3fe51d8-329c-4bb4-b6bc-816d0a13d991 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.323296 May 10 03:11:11.935181 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 4/6] 10.222.0.65 () {64 vars in 1335 bytes} [Tue May 10 03:11:11 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:11:14.228273 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-cf13421c-1377-408f-a8d4-3ccf3e5793f2 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:14.229502 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-cf13421c-1377-408f-a8d4-3ccf3e5793f2 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 May 10 03:11:14.230141 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 3/7] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 03:11:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:11:14.335701 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-9f3a0671-fa43-4fa4-89e0-53db293a1db3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d1", "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 5}} {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:14.357882 dv-cinder-830094-4-smb devstack@n-api.service[103052]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:11:14.357882 dv-cinder-830094-4-smb devstack@n-api.service[103052]: warnings.warn(msg) May 10 03:11:14.486668 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-9f3a0671-fa43-4fa4-89e0-53db293a1db3 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.250413 May 10 03:11:14.487147 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 5/8] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 10 03:11:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 03:11:14.505819 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-116bf3af-a576-4e8b-a986-9ffe72eb748c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:14.505819 dv-cinder-830094-4-smb devstack@n-api.service[103053]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:11:14.505819 dv-cinder-830094-4-smb devstack@n-api.service[103053]: warnings.warn(msg) May 10 03:11:14.661326 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-116bf3af-a576-4e8b-a986-9ffe72eb748c admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.164679 May 10 03:11:14.662101 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 4/9] 10.222.0.65 () {64 vars in 1335 bytes} [Tue May 10 03:11:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:16.936710 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-9f3a0671-fa43-4fa4-89e0-53db293a1db3 admin admin] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:16.937907 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-9f3a0671-fa43-4fa4-89e0-53db293a1db3 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001720 May 10 03:11:16.938765 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 6/10] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 03:11:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:11:16.997625 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-b37239c9-50ea-4c2b-bcc8-df0abe4ac6cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "ram": 1024, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "disk": 10, "name": "ds1G"}} {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:17.067595 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-b37239c9-50ea-4c2b-bcc8-df0abe4ac6cd admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.122533 May 10 03:11:17.068346 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 5/11] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 10 03:11:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:11:17.080350 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-6073a0ad-bfae-450e-a4e8-e41021aa57bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:17.158970 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-6073a0ad-bfae-450e-a4e8-e41021aa57bb admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082303 May 10 03:11:17.159822 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 7/12] 10.222.0.65 () {64 vars in 1335 bytes} [Tue May 10 03:11:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:19.483379 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-b37239c9-50ea-4c2b-bcc8-df0abe4ac6cd admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:19.484227 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-b37239c9-50ea-4c2b-bcc8-df0abe4ac6cd admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 May 10 03:11:19.484630 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 6/13] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 03:11:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:11:19.545952 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-7dff7775-1806-42ba-97b6-03ea10f75515 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds2G", "ram": 2048, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3"}} {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:19.639526 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-7dff7775-1806-42ba-97b6-03ea10f75515 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.148063 May 10 03:11:19.639526 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 8/14] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 10 03:11:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 03:11:19.651340 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-0df7e451-03b6-4418-9b20-130cda69804d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:19.729071 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-0df7e451-03b6-4418-9b20-130cda69804d admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081993 May 10 03:11:19.729663 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 7/15] 10.222.0.65 () {64 vars in 1335 bytes} [Tue May 10 03:11:19 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:22.008156 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-7dff7775-1806-42ba-97b6-03ea10f75515 admin admin] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:22.009170 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-7dff7775-1806-42ba-97b6-03ea10f75515 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 May 10 03:11:22.009574 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 9/16] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 03:11:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:11:22.076561 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-6997b370-0862-412a-a67d-38226c3acc43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4", "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "disk": 20}} {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:22.170436 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-6997b370-0862-412a-a67d-38226c3acc43 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.151489 May 10 03:11:22.171002 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 8/17] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 10 03:11:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:11:22.183951 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-c9102f87-aa84-4c67-af68-a17262f462e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:22.260636 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-c9102f87-aa84-4c67-af68-a17262f462e9 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081316 May 10 03:11:22.261298 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 10/18] 10.222.0.65 () {64 vars in 1335 bytes} [Tue May 10 03:11:22 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:24.529382 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-6997b370-0862-412a-a67d-38226c3acc43 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:24.532369 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-6997b370-0862-412a-a67d-38226c3acc43 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 10 03:11:24.532369 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 9/19] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 03:11:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:11:24.598507 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-ffefd394-d419-4653-a4f3-97e1e0a06913 admin admin] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:24.623408 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-ffefd394-d419-4653-a4f3-97e1e0a06913 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085892 May 10 03:11:24.628563 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 11/20] 10.222.0.65 () {60 vars in 1291 bytes} [Tue May 10 03:11:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:11:27.250262 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-6997b370-0862-412a-a67d-38226c3acc43 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:27.251347 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-6997b370-0862-412a-a67d-38226c3acc43 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 May 10 03:11:27.251798 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 10/21] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 03:11:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:11:27.311817 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-c50cb2fc-0ac4-4c50-8c7e-11878e0a33a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "id": "1", "name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:27.387089 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-c50cb2fc-0ac4-4c50-8c7e-11878e0a33a5 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.129405 May 10 03:11:27.387660 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 12/22] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 10 03:11:27 2022] POST /compute/v2.1/flavors => generated 402 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:11:27.399817 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-76b06c3e-7a33-4ed7-bdcf-fd066ead3a1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:27.495827 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-76b06c3e-7a33-4ed7-bdcf-fd066ead3a1f admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099852 May 10 03:11:27.496414 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 11/23] 10.222.0.65 () {64 vars in 1332 bytes} [Tue May 10 03:11:27 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:29.773439 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-c50cb2fc-0ac4-4c50-8c7e-11878e0a33a5 admin admin] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:29.774423 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-c50cb2fc-0ac4-4c50-8c7e-11878e0a33a5 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 10 03:11:29.774805 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 13/24] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 03:11:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:11:29.834912 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-6b583447-1bce-4479-99a5-546fa8cdefc0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:29.896591 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-6b583447-1bce-4479-99a5-546fa8cdefc0 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.115845 May 10 03:11:29.897161 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 12/25] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 10 03:11:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:11:29.909081 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-5f572414-1945-4389-bf53-6f90769c28f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:29.981700 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-5f572414-1945-4389-bf53-6f90769c28f4 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076138 May 10 03:11:29.982334 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 14/26] 10.222.0.65 () {64 vars in 1332 bytes} [Tue May 10 03:11:29 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:32.454187 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-6b583447-1bce-4479-99a5-546fa8cdefc0 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:32.455215 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-6b583447-1bce-4479-99a5-546fa8cdefc0 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 10 03:11:32.455807 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 13/27] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 03:11:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:11:32.516629 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-e3c21ead-71e8-4f8b-987b-dec6584c7ff0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "rxtx_factor": 1.0, "vcpus": 2, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "3"}} {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:32.628657 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-e3c21ead-71e8-4f8b-987b-dec6584c7ff0 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.167048 May 10 03:11:32.629230 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 15/28] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 10 03:11:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:11:32.640934 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-f4d994ca-a4f8-4fa6-a387-cd2474522fea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:32.717368 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-f4d994ca-a4f8-4fa6-a387-cd2474522fea admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080216 May 10 03:11:32.717952 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 14/29] 10.222.0.65 () {64 vars in 1332 bytes} [Tue May 10 03:11:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:11:34.988083 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-e3c21ead-71e8-4f8b-987b-dec6584c7ff0 admin admin] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:34.989604 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-e3c21ead-71e8-4f8b-987b-dec6584c7ff0 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002031 May 10 03:11:34.990008 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 16/30] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 03:11:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:11:35.054020 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-d1e76f91-bf25-4cfc-bfe5-c668c60017b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large", "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:35.149215 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-d1e76f91-bf25-4cfc-bfe5-c668c60017b9 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.152490 May 10 03:11:35.149848 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 15/31] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 10 03:11:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 03:11:35.167512 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-81aed547-c145-4c37-ade2-3bf9b050c8db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:35.261029 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-81aed547-c145-4c37-ade2-3bf9b050c8db admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100549 May 10 03:11:35.261728 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 17/32] 10.222.0.65 () {64 vars in 1332 bytes} [Tue May 10 03:11:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:11:37.552695 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-d1e76f91-bf25-4cfc-bfe5-c668c60017b9 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:11:37.553797 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-d1e76f91-bf25-4cfc-bfe5-c668c60017b9 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001689 May 10 03:11:37.554450 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 16/33] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 03:11:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:11:37.619838 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-be2e185b-f905-4208-a78e-767732fa1398 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "id": "5", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true, "disk": 160}} {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:37.708425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-be2e185b-f905-4208-a78e-767732fa1398 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.148154 May 10 03:11:37.709442 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 18/34] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 10 03:11:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 03:11:37.722097 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-4670516b-1cda-4c69-aa8a-2c44a590f74e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:11:37.790707 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-4670516b-1cda-4c69-aa8a-2c44a590f74e admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.072356 May 10 03:11:37.791837 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 17/35] 10.222.0.65 () {64 vars in 1332 bytes} [Tue May 10 03:11:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:12:02.120409 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-be2e185b-f905-4208-a78e-767732fa1398 admin admin] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:02.121412 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-be2e185b-f905-4208-a78e-767732fa1398 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 10 03:12:02.121808 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 19/36] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 03:12:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:02.177968 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-52f10094-2894-42e6-b447-ed9fbb74521d admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:02.195614 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-52f10094-2894-42e6-b447-ed9fbb74521d admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067813 May 10 03:12:02.196164 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 18/37] 10.222.0.65 () {60 vars in 1291 bytes} [Tue May 10 03:12:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:12:03.208916 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-be2e185b-f905-4208-a78e-767732fa1398 admin admin] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:03.209924 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-be2e185b-f905-4208-a78e-767732fa1398 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 10 03:12:03.210326 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 20/38] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 03:12:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:03.405842 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-9274d62e-476d-4137-b2f0-3cbc2e09faa2 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:03.411985 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.wsgi [None req-9274d62e-476d-4137-b2f0-3cbc2e09faa2 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 03:12:03.415860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-9274d62e-476d-4137-b2f0-3cbc2e09faa2 admin admin] Request method failure captured: May 10 03:12:03.415860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 03:12:03.415860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Accept: application/json May 10 03:12:03.415860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Accept-Encoding: gzip, deflate May 10 03:12:03.415860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Connection: keep-alive May 10 03:12:03.415860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Content-Length: 0 May 10 03:12:03.415860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Host: 10.222.0.65 May 10 03:12:03.415860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Openstack-Api-Version: compute 2.90 May 10 03:12:03.415860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Openstack-System-Scope: None May 10 03:12:03.415860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: User-Agent: python-novaclient May 10 03:12:03.415860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Auth-Token: gAAAAABiedgDsjjWqHjBr6o784Zl-fXvzZMGszRqLYIDAXVWjvULCodmpJNzGd2vNIeXrRm05BUA53m7K4QRGqbhUs7Fa4nIIWueC5vjwHNblJM0dz7HOSuxCbX2r8vMdvwdHr4BUMONsV8-e_MJmHBmVOjc4fPAW--XPw35fV9E2Dw9mu8HTeU May 10 03:12:03.415860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Domain-Id: None May 10 03:12:03.415860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Domain-Name: None May 10 03:12:03.415860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Identity-Status: Confirmed May 10 03:12:03.415860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Is-Admin-Project: True May 10 03:12:03.415860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Openstack-Nova-Api-Version: 2.90 May 10 03:12:03.415860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Project-Domain-Id: default May 10 03:12:03.415860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Project-Domain-Name: Default May 10 03:12:03.415860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Project-Id: b2907edfa2f14a3b85299455266c251c May 10 03:12:03.415860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Project-Name: admin May 10 03:12:03.415860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Role: reader,admin,member May 10 03:12:03.415860 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Roles: reader,admin,member May 10 03:12:03.417308 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b2907edfa2f14a3b85299455266c251c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b2907edfa2f14a3b85299455266c251c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b2907edfa2f14a3b85299455266c251c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b2907edfa2f14a3b85299455266c251c"}]}] May 10 03:12:03.417308 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Tenant: admin May 10 03:12:03.417308 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Tenant-Id: b2907edfa2f14a3b85299455266c251c May 10 03:12:03.417308 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Tenant-Name: admin May 10 03:12:03.417308 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-User: admin May 10 03:12:03.417308 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-User-Domain-Id: default May 10 03:12:03.417308 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-User-Domain-Name: Default May 10 03:12:03.417308 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-User-Id: 3229265247eb495190623e424798942d May 10 03:12:03.417308 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-User-Name: admin May 10 03:12:03.417308 dv-cinder-830094-4-smb devstack@n-api.service[103053]: method: > May 10 03:12:03.417308 dv-cinder-830094-4-smb devstack@n-api.service[103053]: exception: Flavor 42 could not be found. May 10 03:12:03.417308 dv-cinder-830094-4-smb devstack@n-api.service[103053]: action_args: {'id': '42'} May 10 03:12:03.417308 dv-cinder-830094-4-smb devstack@n-api.service[103053]: {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:12:03.417308 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:03.418194 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 03:12:03.418194 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 03:12:03.418194 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 03:12:03.418194 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 03:12:03.418194 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 03:12:03.418194 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 03:12:03.418194 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 03:12:03.418194 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 03:12:03.418194 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 03:12:03.418194 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:12:03.418194 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 03:12:03.418194 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 03:12:03.418194 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 03:12:03.418194 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi May 10 03:12:03.418194 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:12:03.418194 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi May 10 03:12:03.418194 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:03.418194 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:12:03.418194 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:12:03.423082 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:12:03.423082 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:12:03.423082 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:12:03.423082 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:12:03.423082 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 03:12:03.423082 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 03:12:03.423082 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 03:12:03.423082 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi May 10 03:12:03.423082 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:12:03.423082 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi May 10 03:12:03.423082 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:03.423082 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:12:03.423082 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:12:03.423082 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:12:03.423082 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:12:03.423082 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 03:12:03.423082 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi May 10 03:12:03.423082 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-9274d62e-476d-4137-b2f0-3cbc2e09faa2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:12:03.425451 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-9274d62e-476d-4137-b2f0-3cbc2e09faa2 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062880 May 10 03:12:03.425451 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 19/39] 10.222.0.65 () {60 vars in 1190 bytes} [Tue May 10 03:12:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 03:12:03.428135 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-1b7b5378-a225-4145-b840-d187fa8df35f admin admin] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:03.451214 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-1b7b5378-a225-4145-b840-d187fa8df35f admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026599 May 10 03:12:03.451780 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 21/40] 10.222.0.65 () {60 vars in 1210 bytes} [Tue May 10 03:12:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:12:03.461956 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-9b58c017-f50f-46ab-9c99-7e9b4d4a492a admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:03.483966 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-9b58c017-f50f-46ab-9c99-7e9b4d4a492a admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025873 May 10 03:12:03.484546 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 20/41] 10.222.0.65 () {60 vars in 1210 bytes} [Tue May 10 03:12:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:12:03.494622 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-43641e41-19dd-48a7-a2c4-457f06933c0d admin admin] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:03.500206 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.wsgi [None req-43641e41-19dd-48a7-a2c4-457f06933c0d admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 03:12:03.503425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-43641e41-19dd-48a7-a2c4-457f06933c0d admin admin] Request method failure captured: May 10 03:12:03.503425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 03:12:03.503425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Accept: application/json May 10 03:12:03.503425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Accept-Encoding: gzip, deflate May 10 03:12:03.503425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Connection: keep-alive May 10 03:12:03.503425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Content-Length: 0 May 10 03:12:03.503425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Host: 10.222.0.65 May 10 03:12:03.503425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Openstack-Api-Version: compute 2.90 May 10 03:12:03.503425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Openstack-System-Scope: None May 10 03:12:03.503425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: User-Agent: python-novaclient May 10 03:12:03.503425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Auth-Token: gAAAAABiedgDsjjWqHjBr6o784Zl-fXvzZMGszRqLYIDAXVWjvULCodmpJNzGd2vNIeXrRm05BUA53m7K4QRGqbhUs7Fa4nIIWueC5vjwHNblJM0dz7HOSuxCbX2r8vMdvwdHr4BUMONsV8-e_MJmHBmVOjc4fPAW--XPw35fV9E2Dw9mu8HTeU May 10 03:12:03.503425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Domain-Id: None May 10 03:12:03.503425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Domain-Name: None May 10 03:12:03.503425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Identity-Status: Confirmed May 10 03:12:03.503425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Is-Admin-Project: True May 10 03:12:03.503425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Openstack-Nova-Api-Version: 2.90 May 10 03:12:03.503425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Project-Domain-Id: default May 10 03:12:03.503425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Project-Domain-Name: Default May 10 03:12:03.503425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Project-Id: b2907edfa2f14a3b85299455266c251c May 10 03:12:03.503425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Project-Name: admin May 10 03:12:03.503425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Role: reader,admin,member May 10 03:12:03.503425 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Roles: reader,admin,member May 10 03:12:03.512433 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b2907edfa2f14a3b85299455266c251c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b2907edfa2f14a3b85299455266c251c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b2907edfa2f14a3b85299455266c251c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b2907edfa2f14a3b85299455266c251c"}]}] May 10 03:12:03.512433 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Tenant: admin May 10 03:12:03.512433 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Tenant-Id: b2907edfa2f14a3b85299455266c251c May 10 03:12:03.512433 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Tenant-Name: admin May 10 03:12:03.512433 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-User: admin May 10 03:12:03.512433 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-User-Domain-Id: default May 10 03:12:03.512433 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-User-Domain-Name: Default May 10 03:12:03.512433 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-User-Id: 3229265247eb495190623e424798942d May 10 03:12:03.512433 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-User-Name: admin May 10 03:12:03.512433 dv-cinder-830094-4-smb devstack@n-api.service[103052]: method: > May 10 03:12:03.512433 dv-cinder-830094-4-smb devstack@n-api.service[103052]: exception: Flavor 42 could not be found. May 10 03:12:03.512433 dv-cinder-830094-4-smb devstack@n-api.service[103052]: action_args: {'id': '42'} May 10 03:12:03.512433 dv-cinder-830094-4-smb devstack@n-api.service[103052]: {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:12:03.512433 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:03.513377 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 03:12:03.513377 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 03:12:03.513377 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 03:12:03.513377 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 03:12:03.513377 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 03:12:03.513377 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 03:12:03.513377 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 03:12:03.513377 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 03:12:03.513377 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 03:12:03.513377 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:12:03.513377 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 03:12:03.513377 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 03:12:03.513377 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 03:12:03.513377 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi May 10 03:12:03.513377 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:12:03.513377 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi May 10 03:12:03.513377 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:03.513377 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:12:03.513377 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:12:03.514615 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:12:03.514615 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:12:03.514615 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:12:03.514615 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:12:03.514615 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 03:12:03.514615 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 03:12:03.514615 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 03:12:03.514615 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi May 10 03:12:03.514615 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:12:03.514615 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi May 10 03:12:03.514615 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:03.514615 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:12:03.514615 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:12:03.514615 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:12:03.514615 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:12:03.514615 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 03:12:03.514615 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi May 10 03:12:03.514615 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-43641e41-19dd-48a7-a2c4-457f06933c0d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:12:03.515793 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-43641e41-19dd-48a7-a2c4-457f06933c0d admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014344 May 10 03:12:03.515793 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 22/42] 10.222.0.65 () {60 vars in 1190 bytes} [Tue May 10 03:12:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 10 03:12:04.405873 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-9b58c017-f50f-46ab-9c99-7e9b4d4a492a admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:04.406887 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-9b58c017-f50f-46ab-9c99-7e9b4d4a492a admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 May 10 03:12:04.407285 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 21/43] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 03:12:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:04.594534 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-96bbc42d-f57d-4865-86b0-f47e3651ec79 admin admin] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:04.599709 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.wsgi [None req-96bbc42d-f57d-4865-86b0-f47e3651ec79 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 03:12:04.601261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-96bbc42d-f57d-4865-86b0-f47e3651ec79 admin admin] Request method failure captured: May 10 03:12:04.601261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 03:12:04.601261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Accept: application/json May 10 03:12:04.601261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Accept-Encoding: gzip, deflate May 10 03:12:04.601261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Connection: keep-alive May 10 03:12:04.601261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Content-Length: 0 May 10 03:12:04.601261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Host: 10.222.0.65 May 10 03:12:04.601261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Openstack-Api-Version: compute 2.90 May 10 03:12:04.601261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Openstack-System-Scope: None May 10 03:12:04.601261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: User-Agent: python-novaclient May 10 03:12:04.601261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Auth-Token: gAAAAABiedgEjRPX78hzWr1JJMp8hEhGih4G6GBS6IqIOBi73SGyBuOWPH5xEUGD7HcETZoRNHHGD4HjISBJXoSx5VKbWph5PIf76wGUp2nf41nPcpTGmBFGXsaUySDrMdim6OICZosoX1zvGFUGpL--R6R_H4kUx3nHUpxaTKeWiy67rZ37s6U May 10 03:12:04.601261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Domain-Id: None May 10 03:12:04.601261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Domain-Name: None May 10 03:12:04.601261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Identity-Status: Confirmed May 10 03:12:04.601261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Is-Admin-Project: True May 10 03:12:04.601261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Openstack-Nova-Api-Version: 2.90 May 10 03:12:04.601261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Project-Domain-Id: default May 10 03:12:04.601261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Project-Domain-Name: Default May 10 03:12:04.601261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Project-Id: b2907edfa2f14a3b85299455266c251c May 10 03:12:04.601261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Project-Name: admin May 10 03:12:04.601261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Role: reader,admin,member May 10 03:12:04.601261 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Roles: reader,admin,member May 10 03:12:04.602606 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b2907edfa2f14a3b85299455266c251c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b2907edfa2f14a3b85299455266c251c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b2907edfa2f14a3b85299455266c251c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b2907edfa2f14a3b85299455266c251c"}]}] May 10 03:12:04.602606 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Tenant: admin May 10 03:12:04.602606 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Tenant-Id: b2907edfa2f14a3b85299455266c251c May 10 03:12:04.602606 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Tenant-Name: admin May 10 03:12:04.602606 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-User: admin May 10 03:12:04.602606 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-User-Domain-Id: default May 10 03:12:04.602606 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-User-Domain-Name: Default May 10 03:12:04.602606 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-User-Id: 3229265247eb495190623e424798942d May 10 03:12:04.602606 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-User-Name: admin May 10 03:12:04.602606 dv-cinder-830094-4-smb devstack@n-api.service[103052]: method: > May 10 03:12:04.602606 dv-cinder-830094-4-smb devstack@n-api.service[103052]: exception: Flavor 84 could not be found. May 10 03:12:04.602606 dv-cinder-830094-4-smb devstack@n-api.service[103052]: action_args: {'id': '84'} May 10 03:12:04.602606 dv-cinder-830094-4-smb devstack@n-api.service[103052]: {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:12:04.602606 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:04.603383 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 03:12:04.603383 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 03:12:04.603383 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 03:12:04.603383 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 03:12:04.603383 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 03:12:04.603383 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 03:12:04.603383 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 03:12:04.603383 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 03:12:04.603383 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 03:12:04.603383 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:12:04.603383 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 03:12:04.603383 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 03:12:04.603383 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 03:12:04.603383 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi May 10 03:12:04.603383 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:12:04.603383 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi May 10 03:12:04.603383 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:04.603383 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:12:04.603383 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:12:04.605489 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:12:04.605489 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:12:04.605489 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:12:04.605489 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:12:04.605489 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 03:12:04.605489 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 03:12:04.605489 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 03:12:04.605489 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi May 10 03:12:04.605489 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:12:04.605489 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi May 10 03:12:04.605489 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:04.605489 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:12:04.605489 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:12:04.605489 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:12:04.605489 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:12:04.605489 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 03:12:04.605489 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi May 10 03:12:04.605489 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-96bbc42d-f57d-4865-86b0-f47e3651ec79 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:12:04.607019 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-96bbc42d-f57d-4865-86b0-f47e3651ec79 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060351 May 10 03:12:04.607019 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 23/44] 10.222.0.65 () {60 vars in 1190 bytes} [Tue May 10 03:12:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 03:12:04.612608 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-db012355-1e42-4041-acee-22b06d5e64b9 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:04.626202 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-db012355-1e42-4041-acee-22b06d5e64b9 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017123 May 10 03:12:04.626731 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 22/45] 10.222.0.65 () {60 vars in 1210 bytes} [Tue May 10 03:12:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:12:04.636560 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-189fc514-8aa8-4b51-ad9c-71d81607d040 admin admin] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:04.650835 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-189fc514-8aa8-4b51-ad9c-71d81607d040 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018322 May 10 03:12:04.651359 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 24/46] 10.222.0.65 () {60 vars in 1210 bytes} [Tue May 10 03:12:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:12:04.660152 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-97c95c99-a5db-4080-b437-0c51ca07fec4 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:04.665502 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.wsgi [None req-97c95c99-a5db-4080-b437-0c51ca07fec4 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 03:12:04.666989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-97c95c99-a5db-4080-b437-0c51ca07fec4 admin admin] Request method failure captured: May 10 03:12:04.666989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 03:12:04.666989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Accept: application/json May 10 03:12:04.666989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Accept-Encoding: gzip, deflate May 10 03:12:04.666989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Connection: keep-alive May 10 03:12:04.666989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Content-Length: 0 May 10 03:12:04.666989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Host: 10.222.0.65 May 10 03:12:04.666989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Openstack-Api-Version: compute 2.90 May 10 03:12:04.666989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Openstack-System-Scope: None May 10 03:12:04.666989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: User-Agent: python-novaclient May 10 03:12:04.666989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Auth-Token: gAAAAABiedgEjRPX78hzWr1JJMp8hEhGih4G6GBS6IqIOBi73SGyBuOWPH5xEUGD7HcETZoRNHHGD4HjISBJXoSx5VKbWph5PIf76wGUp2nf41nPcpTGmBFGXsaUySDrMdim6OICZosoX1zvGFUGpL--R6R_H4kUx3nHUpxaTKeWiy67rZ37s6U May 10 03:12:04.666989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Domain-Id: None May 10 03:12:04.666989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Domain-Name: None May 10 03:12:04.666989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Identity-Status: Confirmed May 10 03:12:04.666989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Is-Admin-Project: True May 10 03:12:04.666989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Openstack-Nova-Api-Version: 2.90 May 10 03:12:04.666989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Project-Domain-Id: default May 10 03:12:04.666989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Project-Domain-Name: Default May 10 03:12:04.666989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Project-Id: b2907edfa2f14a3b85299455266c251c May 10 03:12:04.666989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Project-Name: admin May 10 03:12:04.666989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Role: reader,admin,member May 10 03:12:04.666989 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Roles: reader,admin,member May 10 03:12:04.668582 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b2907edfa2f14a3b85299455266c251c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b2907edfa2f14a3b85299455266c251c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b2907edfa2f14a3b85299455266c251c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b2907edfa2f14a3b85299455266c251c"}]}] May 10 03:12:04.668582 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Tenant: admin May 10 03:12:04.668582 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Tenant-Id: b2907edfa2f14a3b85299455266c251c May 10 03:12:04.668582 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Tenant-Name: admin May 10 03:12:04.668582 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-User: admin May 10 03:12:04.668582 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-User-Domain-Id: default May 10 03:12:04.668582 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-User-Domain-Name: Default May 10 03:12:04.668582 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-User-Id: 3229265247eb495190623e424798942d May 10 03:12:04.668582 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-User-Name: admin May 10 03:12:04.668582 dv-cinder-830094-4-smb devstack@n-api.service[103053]: method: > May 10 03:12:04.668582 dv-cinder-830094-4-smb devstack@n-api.service[103053]: exception: Flavor 84 could not be found. May 10 03:12:04.668582 dv-cinder-830094-4-smb devstack@n-api.service[103053]: action_args: {'id': '84'} May 10 03:12:04.668582 dv-cinder-830094-4-smb devstack@n-api.service[103053]: {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:12:04.668582 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:04.669549 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 03:12:04.669549 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 03:12:04.669549 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 03:12:04.669549 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 03:12:04.669549 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 03:12:04.669549 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 03:12:04.669549 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 03:12:04.669549 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 03:12:04.669549 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 03:12:04.669549 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:12:04.669549 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 03:12:04.669549 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 03:12:04.669549 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 03:12:04.669549 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi May 10 03:12:04.669549 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:12:04.669549 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi May 10 03:12:04.669549 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:04.669549 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:12:04.669549 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:12:04.670616 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:12:04.670616 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:12:04.670616 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:12:04.670616 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:12:04.670616 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 03:12:04.670616 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 03:12:04.670616 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 03:12:04.670616 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi May 10 03:12:04.670616 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:12:04.670616 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi May 10 03:12:04.670616 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:04.670616 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:12:04.670616 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:12:04.670616 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:12:04.670616 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:12:04.670616 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 03:12:04.670616 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi May 10 03:12:04.670616 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-97c95c99-a5db-4080-b437-0c51ca07fec4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:12:04.671622 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-97c95c99-a5db-4080-b437-0c51ca07fec4 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011836 May 10 03:12:04.671622 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 23/47] 10.222.0.65 () {60 vars in 1190 bytes} [Tue May 10 03:12:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 03:12:05.552654 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-189fc514-8aa8-4b51-ad9c-71d81607d040 admin admin] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:05.553729 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-189fc514-8aa8-4b51-ad9c-71d81607d040 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 May 10 03:12:05.554121 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 25/48] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 03:12:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:05.741054 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-bec6e3b7-5997-4b93-9272-4c864d8c61f4 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:05.746569 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.wsgi [None req-bec6e3b7-5997-4b93-9272-4c864d8c61f4 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 03:12:05.748063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-bec6e3b7-5997-4b93-9272-4c864d8c61f4 admin admin] Request method failure captured: May 10 03:12:05.748063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 03:12:05.748063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Accept: application/json May 10 03:12:05.748063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Accept-Encoding: gzip, deflate May 10 03:12:05.748063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Connection: keep-alive May 10 03:12:05.748063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Content-Length: 0 May 10 03:12:05.748063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Host: 10.222.0.65 May 10 03:12:05.748063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Openstack-Api-Version: compute 2.90 May 10 03:12:05.748063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Openstack-System-Scope: None May 10 03:12:05.748063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: User-Agent: python-novaclient May 10 03:12:05.748063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Auth-Token: gAAAAABiedgFglCBWlhJTj4P4ZKAbCRpNItTbQw5GWVctzMtsLr0eUIW3dF4LmkkZhAMla4VxbJ-nhu4AJ6dozedLCStINtE9OdZowBMkrejnTJ-2SFPebALpoYFq6IjmANa8IFWIsZsbU8s8OVdR-z4Z2XR86dnmpI9xT0dQ3Uu2TwARURX0O4 May 10 03:12:05.748063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Domain-Id: None May 10 03:12:05.748063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Domain-Name: None May 10 03:12:05.748063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Identity-Status: Confirmed May 10 03:12:05.748063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Is-Admin-Project: True May 10 03:12:05.748063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Openstack-Nova-Api-Version: 2.90 May 10 03:12:05.748063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Project-Domain-Id: default May 10 03:12:05.748063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Project-Domain-Name: Default May 10 03:12:05.748063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Project-Id: b2907edfa2f14a3b85299455266c251c May 10 03:12:05.748063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Project-Name: admin May 10 03:12:05.748063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Role: reader,admin,member May 10 03:12:05.748063 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Roles: reader,admin,member May 10 03:12:05.749583 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b2907edfa2f14a3b85299455266c251c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b2907edfa2f14a3b85299455266c251c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b2907edfa2f14a3b85299455266c251c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b2907edfa2f14a3b85299455266c251c"}]}] May 10 03:12:05.749583 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Tenant: admin May 10 03:12:05.749583 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Tenant-Id: b2907edfa2f14a3b85299455266c251c May 10 03:12:05.749583 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-Tenant-Name: admin May 10 03:12:05.749583 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-User: admin May 10 03:12:05.749583 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-User-Domain-Id: default May 10 03:12:05.749583 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-User-Domain-Name: Default May 10 03:12:05.749583 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-User-Id: 3229265247eb495190623e424798942d May 10 03:12:05.749583 dv-cinder-830094-4-smb devstack@n-api.service[103053]: X-User-Name: admin May 10 03:12:05.749583 dv-cinder-830094-4-smb devstack@n-api.service[103053]: method: > May 10 03:12:05.749583 dv-cinder-830094-4-smb devstack@n-api.service[103053]: exception: Flavor 451 could not be found. May 10 03:12:05.749583 dv-cinder-830094-4-smb devstack@n-api.service[103053]: action_args: {'id': '451'} May 10 03:12:05.749583 dv-cinder-830094-4-smb devstack@n-api.service[103053]: {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:12:05.749583 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:05.750483 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 03:12:05.750483 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 03:12:05.750483 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 03:12:05.750483 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 03:12:05.750483 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 03:12:05.750483 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 03:12:05.750483 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 03:12:05.750483 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 03:12:05.750483 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 03:12:05.750483 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:12:05.750483 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 03:12:05.750483 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 03:12:05.750483 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 03:12:05.750483 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi May 10 03:12:05.750483 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:12:05.750483 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi May 10 03:12:05.750483 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:05.750483 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:12:05.750483 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:12:05.751541 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:12:05.751541 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:12:05.751541 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:12:05.751541 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:12:05.751541 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 03:12:05.751541 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 03:12:05.751541 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 03:12:05.751541 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi May 10 03:12:05.751541 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:12:05.751541 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi May 10 03:12:05.751541 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:05.751541 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:12:05.751541 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:12:05.751541 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:12:05.751541 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:12:05.751541 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 03:12:05.751541 dv-cinder-830094-4-smb devstack@n-api.service[103053]: ERROR nova.api.openstack.wsgi May 10 03:12:05.751541 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-bec6e3b7-5997-4b93-9272-4c864d8c61f4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103053) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:12:05.752622 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-bec6e3b7-5997-4b93-9272-4c864d8c61f4 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058747 May 10 03:12:05.752622 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 24/49] 10.222.0.65 () {60 vars in 1193 bytes} [Tue May 10 03:12:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 03:12:05.759444 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-2eab88f2-bcd2-4b76-9f9d-3c4f89a8d3d2 admin admin] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:05.772876 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-2eab88f2-bcd2-4b76-9f9d-3c4f89a8d3d2 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017353 May 10 03:12:05.773442 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 26/50] 10.222.0.65 () {60 vars in 1210 bytes} [Tue May 10 03:12:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:12:05.786786 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-7c1fa953-fc5a-4ba2-8a20-51661fe94a35 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:05.801607 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-7c1fa953-fc5a-4ba2-8a20-51661fe94a35 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020026 May 10 03:12:05.802167 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 25/51] 10.222.0.65 () {60 vars in 1210 bytes} [Tue May 10 03:12:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:12:05.811506 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-72dafcc1-3a19-41c2-9521-463b4b8fe9fc admin admin] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:05.816974 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.wsgi [None req-72dafcc1-3a19-41c2-9521-463b4b8fe9fc admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 03:12:05.818466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-72dafcc1-3a19-41c2-9521-463b4b8fe9fc admin admin] Request method failure captured: May 10 03:12:05.818466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 03:12:05.818466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Accept: application/json May 10 03:12:05.818466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Accept-Encoding: gzip, deflate May 10 03:12:05.818466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Connection: keep-alive May 10 03:12:05.818466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Content-Length: 0 May 10 03:12:05.818466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Host: 10.222.0.65 May 10 03:12:05.818466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Openstack-Api-Version: compute 2.90 May 10 03:12:05.818466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Openstack-System-Scope: None May 10 03:12:05.818466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: User-Agent: python-novaclient May 10 03:12:05.818466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Auth-Token: gAAAAABiedgFglCBWlhJTj4P4ZKAbCRpNItTbQw5GWVctzMtsLr0eUIW3dF4LmkkZhAMla4VxbJ-nhu4AJ6dozedLCStINtE9OdZowBMkrejnTJ-2SFPebALpoYFq6IjmANa8IFWIsZsbU8s8OVdR-z4Z2XR86dnmpI9xT0dQ3Uu2TwARURX0O4 May 10 03:12:05.818466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Domain-Id: None May 10 03:12:05.818466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Domain-Name: None May 10 03:12:05.818466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Identity-Status: Confirmed May 10 03:12:05.818466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Is-Admin-Project: True May 10 03:12:05.818466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Openstack-Nova-Api-Version: 2.90 May 10 03:12:05.818466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Project-Domain-Id: default May 10 03:12:05.818466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Project-Domain-Name: Default May 10 03:12:05.818466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Project-Id: b2907edfa2f14a3b85299455266c251c May 10 03:12:05.818466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Project-Name: admin May 10 03:12:05.818466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Role: reader,admin,member May 10 03:12:05.818466 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Roles: reader,admin,member May 10 03:12:05.820048 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b2907edfa2f14a3b85299455266c251c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b2907edfa2f14a3b85299455266c251c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b2907edfa2f14a3b85299455266c251c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b2907edfa2f14a3b85299455266c251c"}]}] May 10 03:12:05.820048 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Tenant: admin May 10 03:12:05.820048 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Tenant-Id: b2907edfa2f14a3b85299455266c251c May 10 03:12:05.820048 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-Tenant-Name: admin May 10 03:12:05.820048 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-User: admin May 10 03:12:05.820048 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-User-Domain-Id: default May 10 03:12:05.820048 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-User-Domain-Name: Default May 10 03:12:05.820048 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-User-Id: 3229265247eb495190623e424798942d May 10 03:12:05.820048 dv-cinder-830094-4-smb devstack@n-api.service[103052]: X-User-Name: admin May 10 03:12:05.820048 dv-cinder-830094-4-smb devstack@n-api.service[103052]: method: > May 10 03:12:05.820048 dv-cinder-830094-4-smb devstack@n-api.service[103052]: exception: Flavor 451 could not be found. May 10 03:12:05.820048 dv-cinder-830094-4-smb devstack@n-api.service[103052]: action_args: {'id': '451'} May 10 03:12:05.820048 dv-cinder-830094-4-smb devstack@n-api.service[103052]: {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:12:05.820048 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:05.820889 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 03:12:05.820889 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 03:12:05.820889 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 03:12:05.820889 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 03:12:05.820889 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 03:12:05.820889 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 03:12:05.820889 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 03:12:05.820889 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 03:12:05.820889 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 03:12:05.820889 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:12:05.820889 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 03:12:05.820889 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 03:12:05.820889 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 03:12:05.820889 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi May 10 03:12:05.820889 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:12:05.820889 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi May 10 03:12:05.820889 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:05.820889 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:12:05.820889 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:12:05.822279 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:12:05.822279 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:12:05.822279 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:12:05.822279 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:12:05.822279 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 03:12:05.822279 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 03:12:05.822279 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 03:12:05.822279 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi May 10 03:12:05.822279 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:12:05.822279 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi May 10 03:12:05.822279 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:12:05.822279 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:12:05.822279 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:12:05.822279 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:12:05.822279 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:12:05.822279 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 03:12:05.822279 dv-cinder-830094-4-smb devstack@n-api.service[103052]: ERROR nova.api.openstack.wsgi May 10 03:12:05.822279 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-72dafcc1-3a19-41c2-9521-463b4b8fe9fc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:12:05.823381 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-72dafcc1-3a19-41c2-9521-463b4b8fe9fc admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011889 May 10 03:12:05.823381 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 27/52] 10.222.0.65 () {60 vars in 1193 bytes} [Tue May 10 03:12:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 03:12:06.703429 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-7c1fa953-fc5a-4ba2-8a20-51661fe94a35 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:06.704522 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-7c1fa953-fc5a-4ba2-8a20-51661fe94a35 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 10 03:12:06.704893 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 26/53] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 03:12:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:06.890442 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-35492d40-cd4c-4587-b0d4-7ba5944f4a98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:12:06.990399 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-35492d40-cd4c-4587-b0d4-7ba5944f4a98 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.150146 May 10 03:12:06.990865 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 28/54] 10.222.0.65 () {64 vars in 1235 bytes} [Tue May 10 03:12:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:12:07.873974 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-7c1fa953-fc5a-4ba2-8a20-51661fe94a35 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:07.874962 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-7c1fa953-fc5a-4ba2-8a20-51661fe94a35 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 May 10 03:12:07.875381 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 27/55] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 03:12:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:08.061938 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-0b083089-9022-4793-a6be-423123a59ed3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:12:08.124055 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-0b083089-9022-4793-a6be-423123a59ed3 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.113400 May 10 03:12:08.124601 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 29/56] 10.222.0.65 () {64 vars in 1235 bytes} [Tue May 10 03:12:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 03:12:08.998311 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-7c1fa953-fc5a-4ba2-8a20-51661fe94a35 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:08.999300 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-7c1fa953-fc5a-4ba2-8a20-51661fe94a35 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 May 10 03:12:08.999700 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 28/57] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 03:12:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:09.186047 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-d26662c4-8c74-4445-8bba-14c1958b0866 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:12:09.306061 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-d26662c4-8c74-4445-8bba-14c1958b0866 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.170845 May 10 03:12:09.306539 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 30/58] 10.222.0.65 () {64 vars in 1235 bytes} [Tue May 10 03:12:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 03:12:10.191333 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-7c1fa953-fc5a-4ba2-8a20-51661fe94a35 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:10.192368 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-7c1fa953-fc5a-4ba2-8a20-51661fe94a35 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 May 10 03:12:10.192766 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 29/59] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 03:12:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:10.380978 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-7c8822d1-4a78-4a9e-bc6b-0bb18d090ae2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:12:10.455634 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-7c8822d1-4a78-4a9e-bc6b-0bb18d090ae2 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.126028 May 10 03:12:10.456528 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 31/60] 10.222.0.65 () {64 vars in 1235 bytes} [Tue May 10 03:12:10 2022] POST /compute/v2.1/flavors => generated 409 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:12:11.330026 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-7c1fa953-fc5a-4ba2-8a20-51661fe94a35 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:11.331086 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-7c1fa953-fc5a-4ba2-8a20-51661fe94a35 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 May 10 03:12:11.331484 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 30/61] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 03:12:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:12:11.517395 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-8530a63f-e8f6-4fe4-8f81-ae43c80b1b4c admin admin] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:12:11.535976 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-8530a63f-e8f6-4fe4-8f81-ae43c80b1b4c admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069974 May 10 03:12:11.538372 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 32/62] 10.222.0.65 () {60 vars in 1202 bytes} [Tue May 10 03:12:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:13:13.821446 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-7c1fa953-fc5a-4ba2-8a20-51661fe94a35 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:13.822449 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-7c1fa953-fc5a-4ba2-8a20-51661fe94a35 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001730 May 10 03:13:13.822859 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 31/63] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 10 03:13:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:13:13.879299 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-96de415e-830e-4a24-bc79-bd55e4c8d81c admin admin] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:13.899630 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-96de415e-830e-4a24-bc79-bd55e4c8d81c admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070928 May 10 03:13:13.900186 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 33/64] 10.222.0.65 () {60 vars in 1291 bytes} [Tue May 10 03:13:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:13:13.923317 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-d6e9b5d3-04de-4d0a-8029-d5e71906abf6 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:13.931902 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-d6e9b5d3-04de-4d0a-8029-d5e71906abf6 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013114 May 10 03:13:13.932460 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 32/65] 10.222.0.65 () {60 vars in 1282 bytes} [Tue May 10 03:13:13 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:13:13.943459 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-e8a5a132-14cf-4b54-a4b1-7620134dfec2 admin admin] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:13.951562 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-e8a5a132-14cf-4b54-a4b1-7620134dfec2 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011580 May 10 03:13:13.952080 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 34/66] 10.222.0.65 () {60 vars in 1285 bytes} [Tue May 10 03:13:13 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:13:13.963164 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-eb29f07c-1066-4daf-80c4-36ca7ae03cd5 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:13.970541 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-eb29f07c-1066-4daf-80c4-36ca7ae03cd5 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010913 May 10 03:13:13.971048 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 33/67] 10.222.0.65 () {60 vars in 1285 bytes} [Tue May 10 03:13:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:13:13.982128 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-24f0d4c9-e8a6-45ea-952b-6f8ff4f2153e admin admin] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:13:13.989685 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-24f0d4c9-e8a6-45ea-952b-6f8ff4f2153e admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011143 May 10 03:13:13.990223 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 35/68] 10.222.0.65 () {60 vars in 1282 bytes} [Tue May 10 03:13:13 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:16:52.423942 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-eb29f07c-1066-4daf-80c4-36ca7ae03cd5 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:52.424974 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-eb29f07c-1066-4daf-80c4-36ca7ae03cd5 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 10 03:16:52.425378 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 34/69] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 03:16:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:52.689707 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-fe0caf27-e94d-490e-bec3-e23b5ebd95d9 admin admin] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:52.690921 dv-cinder-830094-4-smb devstack@n-api.service[103052]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:16:52.690921 dv-cinder-830094-4-smb devstack@n-api.service[103052]: warnings.warn(msg) May 10 03:16:52.692237 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_concurrency.lockutils [None req-fe0caf27-e94d-490e-bec3-e23b5ebd95d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:52.692681 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_concurrency.lockutils [None req-fe0caf27-e94d-490e-bec3-e23b5ebd95d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:52.693522 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_concurrency.lockutils [None req-fe0caf27-e94d-490e-bec3-e23b5ebd95d9 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:52.693951 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_concurrency.lockutils [None req-fe0caf27-e94d-490e-bec3-e23b5ebd95d9 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:52.727875 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-fe0caf27-e94d-490e-bec3-e23b5ebd95d9 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.90 time: 0.147454 May 10 03:16:52.728478 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 36/70] 10.222.0.65 () {60 vars in 1193 bytes} [Tue May 10 03:16:52 2022] GET /compute/v2.1/os-services => generated 785 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:16:53.617556 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-eb29f07c-1066-4daf-80c4-36ca7ae03cd5 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:53.618630 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-eb29f07c-1066-4daf-80c4-36ca7ae03cd5 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 10 03:16:53.619030 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 35/71] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 03:16:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:16:53.810696 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-5e2bbe69-70ca-458e-8ead-48322747c0c6 admin admin] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:16:53.811942 dv-cinder-830094-4-smb devstack@n-api.service[103052]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:16:53.811942 dv-cinder-830094-4-smb devstack@n-api.service[103052]: warnings.warn(msg) May 10 03:16:53.813153 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_concurrency.lockutils [None req-5e2bbe69-70ca-458e-8ead-48322747c0c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:53.813592 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_concurrency.lockutils [None req-5e2bbe69-70ca-458e-8ead-48322747c0c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:53.814371 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_concurrency.lockutils [None req-5e2bbe69-70ca-458e-8ead-48322747c0c6 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:16:53.814801 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_concurrency.lockutils [None req-5e2bbe69-70ca-458e-8ead-48322747c0c6 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:16:53.834158 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-5e2bbe69-70ca-458e-8ead-48322747c0c6 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.90 time: 0.075526 May 10 03:16:53.834635 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 37/72] 10.222.0.65 () {60 vars in 1193 bytes} [Tue May 10 03:16:53 2022] GET /compute/v2.1/os-services => generated 785 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:17:05.151455 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-eb29f07c-1066-4daf-80c4-36ca7ae03cd5 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:05.152494 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-eb29f07c-1066-4daf-80c4-36ca7ae03cd5 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 10 03:17:05.152895 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 36/73] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 03:17:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:17:05.348608 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-d5dc725c-5ce2-40e4-a975-723ad86ef417 admin admin] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:05.349795 dv-cinder-830094-4-smb devstack@n-api.service[103052]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:17:05.349795 dv-cinder-830094-4-smb devstack@n-api.service[103052]: warnings.warn(msg) May 10 03:17:05.350999 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_concurrency.lockutils [None req-d5dc725c-5ce2-40e4-a975-723ad86ef417 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:05.351435 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_concurrency.lockutils [None req-d5dc725c-5ce2-40e4-a975-723ad86ef417 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:05.352248 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_concurrency.lockutils [None req-d5dc725c-5ce2-40e4-a975-723ad86ef417 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:05.352693 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_concurrency.lockutils [None req-d5dc725c-5ce2-40e4-a975-723ad86ef417 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:05.377370 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-d5dc725c-5ce2-40e4-a975-723ad86ef417 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1029 microversion: 2.90 time: 0.079715 May 10 03:17:05.377906 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 38/74] 10.222.0.65 () {60 vars in 1193 bytes} [Tue May 10 03:17:05 2022] GET /compute/v2.1/os-services => generated 1029 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:17:06.268661 dv-cinder-830094-4-smb devstack@n-api.service[103053]: DEBUG nova.api.openstack.wsgi [None req-eb29f07c-1066-4daf-80c4-36ca7ae03cd5 admin admin] Calling method '>' {{(pid=103053) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:06.269655 dv-cinder-830094-4-smb devstack@n-api.service[103053]: INFO nova.api.openstack.requestlog [None req-eb29f07c-1066-4daf-80c4-36ca7ae03cd5 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 May 10 03:17:06.270051 dv-cinder-830094-4-smb devstack@n-api.service[103053]: [pid: 103053|app: 0|req: 37/75] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 10 03:17:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:17:06.465147 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG nova.api.openstack.wsgi [None req-fdb50b6b-5a07-479d-8196-e3076300f975 admin admin] Calling method '>' {{(pid=103052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:17:06.466311 dv-cinder-830094-4-smb devstack@n-api.service[103052]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 03:17:06.466311 dv-cinder-830094-4-smb devstack@n-api.service[103052]: warnings.warn(msg) May 10 03:17:06.467491 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_concurrency.lockutils [None req-fdb50b6b-5a07-479d-8196-e3076300f975 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:06.467931 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_concurrency.lockutils [None req-fdb50b6b-5a07-479d-8196-e3076300f975 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:06.468741 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_concurrency.lockutils [None req-fdb50b6b-5a07-479d-8196-e3076300f975 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:17:06.469172 dv-cinder-830094-4-smb devstack@n-api.service[103052]: DEBUG oslo_concurrency.lockutils [None req-fdb50b6b-5a07-479d-8196-e3076300f975 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:17:06.490820 dv-cinder-830094-4-smb devstack@n-api.service[103052]: INFO nova.api.openstack.requestlog [None req-fdb50b6b-5a07-479d-8196-e3076300f975 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1029 microversion: 2.90 time: 0.076832 May 10 03:17:06.491290 dv-cinder-830094-4-smb devstack@n-api.service[103052]: [pid: 103052|app: 0|req: 39/76] 10.222.0.65 () {60 vars in 1193 bytes} [Tue May 10 03:17:06 2022] GET /compute/v2.1/os-services => generated 1029 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:18:05.252970 dv-cinder-830094-4-smb devstack@n-api.service[103051]: Tue May 10 03:18:05 2022 - graceful shutdown triggered... May 10 03:18:05.253153 dv-cinder-830094-4-smb systemd[1]: Stopping Devstack devstack@n-api.service... May 10 03:18:05.254053 dv-cinder-830094-4-smb devstack@n-api.service[103053]: Gracefully killing worker 2 (pid: 103053)... May 10 03:18:05.254441 dv-cinder-830094-4-smb devstack@n-api.service[103052]: Gracefully killing worker 1 (pid: 103052)... May 10 03:18:06.254830 dv-cinder-830094-4-smb devstack@n-api.service[103051]: worker 1 buried after 1 seconds May 10 03:18:06.254830 dv-cinder-830094-4-smb devstack@n-api.service[103051]: worker 2 buried after 1 seconds May 10 03:18:06.254830 dv-cinder-830094-4-smb devstack@n-api.service[103051]: goodbye to uWSGI. May 10 03:18:06.256498 dv-cinder-830094-4-smb systemd[1]: devstack@n-api.service: Succeeded. May 10 03:18:06.257057 dv-cinder-830094-4-smb systemd[1]: Stopped Devstack devstack@n-api.service. May 10 03:18:06.259767 dv-cinder-830094-4-smb systemd[1]: Starting Devstack devstack@n-api.service... May 10 03:18:06.271862 dv-cinder-830094-4-smb devstack@n-api.service[117381]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 03:18:06.296084 dv-cinder-830094-4-smb devstack@n-api.service[117381]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 03:18:06 2022] *** May 10 03:18:06.296084 dv-cinder-830094-4-smb devstack@n-api.service[117381]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 03:18:06.296084 dv-cinder-830094-4-smb devstack@n-api.service[117381]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 03:18:06.296084 dv-cinder-830094-4-smb devstack@n-api.service[117381]: nodename: dv-cinder-830094-4-smb May 10 03:18:06.296084 dv-cinder-830094-4-smb devstack@n-api.service[117381]: machine: x86_64 May 10 03:18:06.296084 dv-cinder-830094-4-smb devstack@n-api.service[117381]: clock source: unix May 10 03:18:06.296084 dv-cinder-830094-4-smb devstack@n-api.service[117381]: pcre jit disabled May 10 03:18:06.296084 dv-cinder-830094-4-smb devstack@n-api.service[117381]: detected number of CPU cores: 4 May 10 03:18:06.296084 dv-cinder-830094-4-smb devstack@n-api.service[117381]: current working directory: / May 10 03:18:06.296084 dv-cinder-830094-4-smb devstack@n-api.service[117381]: detected binary path: /usr/bin/uwsgi-core May 10 03:18:06.296084 dv-cinder-830094-4-smb devstack@n-api.service[117381]: your processes number limit is 47680 May 10 03:18:06.297048 dv-cinder-830094-4-smb devstack@n-api.service[117381]: your memory page size is 4096 bytes May 10 03:18:06.297048 dv-cinder-830094-4-smb devstack@n-api.service[117381]: detected max file descriptor number: 2048 May 10 03:18:06.297048 dv-cinder-830094-4-smb devstack@n-api.service[117381]: lock engine: pthread robust mutexes May 10 03:18:06.297048 dv-cinder-830094-4-smb devstack@n-api.service[117381]: thunder lock: enabled May 10 03:18:06.297048 dv-cinder-830094-4-smb devstack@n-api.service[117381]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 03:18:06.297048 dv-cinder-830094-4-smb devstack@n-api.service[117381]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 03:18:06.342570 dv-cinder-830094-4-smb devstack@n-api.service[117381]: Python main interpreter initialized at 0x560b1ab099c0 May 10 03:18:06.342570 dv-cinder-830094-4-smb devstack@n-api.service[117381]: python threads support enabled May 10 03:18:06.342570 dv-cinder-830094-4-smb devstack@n-api.service[117381]: your server socket listen backlog is limited to 100 connections May 10 03:18:06.342570 dv-cinder-830094-4-smb devstack@n-api.service[117381]: your mercy for graceful operations on workers is 90 seconds May 10 03:18:06.343127 dv-cinder-830094-4-smb devstack@n-api.service[117381]: mapped 403077 bytes (393 KB) for 2 cores May 10 03:18:06.343127 dv-cinder-830094-4-smb devstack@n-api.service[117381]: *** Operational MODE: preforking *** May 10 03:18:06.343286 dv-cinder-830094-4-smb devstack@n-api.service[117381]: *** uWSGI is running in multiple interpreter mode *** May 10 03:18:06.343286 dv-cinder-830094-4-smb devstack@n-api.service[117381]: spawned uWSGI master process (pid: 117381) May 10 03:18:06.343472 dv-cinder-830094-4-smb systemd[1]: Started Devstack devstack@n-api.service. May 10 03:18:06.344443 dv-cinder-830094-4-smb devstack@n-api.service[117381]: spawned uWSGI worker 1 (pid: 117399, cores: 1) May 10 03:18:06.344443 dv-cinder-830094-4-smb devstack@n-api.service[117381]: spawned uWSGI worker 2 (pid: 117400, cores: 1) May 10 03:18:06.344624 dv-cinder-830094-4-smb devstack@n-api.service[117381]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 03:18:07.564711 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 03:18:07.570269 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 03:18:08.372752 dv-cinder-830094-4-smb devstack@n-api.service[117399]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 03:18:08.372752 dv-cinder-830094-4-smb devstack@n-api.service[117399]: from cryptography.utils import int_from_bytes May 10 03:18:08.373087 dv-cinder-830094-4-smb devstack@n-api.service[117399]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 03:18:08.373087 dv-cinder-830094-4-smb devstack@n-api.service[117399]: from cryptography.utils import int_from_bytes May 10 03:18:08.378432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 03:18:08.378432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: from cryptography.utils import int_from_bytes May 10 03:18:08.378748 dv-cinder-830094-4-smb devstack@n-api.service[117400]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 03:18:08.378748 dv-cinder-830094-4-smb devstack@n-api.service[117400]: from cryptography.utils import int_from_bytes May 10 03:18:10.782516 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 03:18:10.782983 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 03:18:10.783324 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 03:18:10.783692 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 03:18:10.783954 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 03:18:10.784463 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.784799 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.785126 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.785451 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.785871 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.786089 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.786412 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.786757 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.787057 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.787318 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.787641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.787970 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830094-4-smb {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.788325 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.788639 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.788957 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.789278 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.789859 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.790190 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.790509 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.791016 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.792789 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.792789 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.792789 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.792789 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.792789 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.793191 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.793454 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.793761 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.794095 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.794422 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.794850 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830094-4-smb {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.795136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.795454 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.795778 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.796510 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.796830 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.797160 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.797479 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.797798 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.798100 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.798436 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.798762 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.799076 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.799458 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.799693 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.800045 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.800348 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.800666 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.800970 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.801290 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.801538 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.801854 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.802186 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.802510 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.802987 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.803196 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.803425 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.803745 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.804092 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.804413 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.804729 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.805554 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.805554 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.805731 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.805941 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.806256 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.806568 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.807058 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.807535 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.808596 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.809085 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.809561 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.810123 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.810538 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.811026 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.811538 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.812041 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.812517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.812852 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.813183 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.813504 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.813949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.814271 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.814682 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.814918 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.815243 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.815472 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.815884 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.816238 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.816564 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.816881 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.817197 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.817729 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.818188 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.818678 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.818992 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.819473 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.819790 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.820131 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.820608 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.820929 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.821245 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.821560 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.821885 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.822362 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.822685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.823003 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.823322 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.824225 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.824554 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.824869 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.825188 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.825518 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.825842 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.826147 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.826470 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.826782 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.827096 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.827421 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.827727 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.828073 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.832127 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.832127 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.832127 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.832127 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.832127 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.832127 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.832127 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.832127 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.832695 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.832695 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.832695 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.832695 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.832695 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.832695 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.833107 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.833107 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.833396 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.837457 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.837457 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.837457 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.837457 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.837457 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.837457 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.837457 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.837457 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.838156 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.838156 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.838156 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.838156 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.838156 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.838156 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.838709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.838801 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.839092 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.839422 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.839743 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.840083 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.840418 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.840824 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.841143 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.841492 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.841841 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.842160 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.842490 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.842823 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.843146 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.843464 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.843780 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.844140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.844486 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.844807 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.845133 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.845454 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.845777 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.846173 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.846408 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.846727 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.847068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.847492 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.847823 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.848172 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.848499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.848816 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.849133 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.849491 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.849968 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.850283 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.850602 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.850922 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.851235 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.851566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.851897 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.852240 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.852581 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.852894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.853217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.853533 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.853858 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.854160 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.854487 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.854827 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.855200 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.855535 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.855851 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.856191 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.857976 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.857976 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.857976 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.857976 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.857976 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.863342 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.863342 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.863342 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.863342 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.863342 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.863342 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.863342 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.863342 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.863985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.863985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.863985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.863985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.863985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.863985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.863985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.863985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.864657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.864657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.864657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.864657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.864657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.864657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.865133 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.865217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.865522 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.865834 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.866143 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.866453 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.866800 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.867109 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.867457 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.867796 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.868145 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.868475 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.868794 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.869117 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.869429 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.869747 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.870066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.871023 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.871352 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.871670 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.871997 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.872337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.872665 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.872983 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.873308 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.873617 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.873937 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.874283 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.874621 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.874946 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.875274 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.875600 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.875920 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.876261 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.876582 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.876900 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.877229 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.877547 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.877866 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.878244 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.878633 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.879002 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.879273 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.879596 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.882097 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.882097 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.882097 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.882097 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.882097 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.882097 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.882097 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.882097 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.883288 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.883288 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.883288 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.883288 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.883643 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.883901 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.884224 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.884538 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.884846 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.885164 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.885495 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.885782 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.886005 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 03:18:10.886925 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.887036 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.887270 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.887460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 03:18:10.887586 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.887910 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.888055 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 03:18:10.888384 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.888480 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 03:18:10.888649 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 03:18:10.888768 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.888989 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.889088 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.889316 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.889440 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.889632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.889819 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.890012 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.890178 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.890341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.890493 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.890652 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.890805 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.890939 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.891026 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.891259 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.891375 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.891566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.891663 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.891874 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.891979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.897410 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.897581 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.897727 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.897873 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830094-4-smb {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.898101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.898260 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.898447 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.898594 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.898736 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.899021 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.899156 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.899311 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.899606 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.899800 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.899960 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.900173 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.900317 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.900464 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.900604 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.901024 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.901241 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.901241 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.901531 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.901531 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.902295 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.902460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.902610 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.902610 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.902880 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.902880 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.903132 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.903270 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.903409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.903539 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.903679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.903679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.903936 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.903936 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.904254 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.904399 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.904564 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.904564 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.904564 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.904564 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.904564 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.905261 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830094-4-smb {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.905409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.908653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.908778 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.908872 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.908975 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.909088 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.909193 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.909193 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.909193 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.909509 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.909790 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.909790 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.909973 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.910076 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.910227 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.910327 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.910415 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.910500 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.910627 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.910745 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.910846 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.910940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.911026 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.911117 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.911211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.911306 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.911392 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.911476 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.911559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.911650 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.911743 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.911837 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.911837 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.912000 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.912174 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.912283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.912387 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.912474 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.912558 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.912727 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.912829 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.912915 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.912915 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.913084 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.913176 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.913262 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.913369 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.913464 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.913464 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.913694 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.913795 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.913881 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.913881 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.914047 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.914140 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.914226 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.914311 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.914404 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.914743 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.915038 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.915181 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.915315 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.915413 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.915499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.915713 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.915805 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.915898 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.915990 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.916155 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.916253 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.916253 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.916429 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.916522 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.916613 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.916723 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.916811 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.916904 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.916995 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.917081 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.917173 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.917328 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.917908 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.917908 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.918071 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.918071 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.918224 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.918316 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.918415 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.918508 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.918599 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.918734 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.918837 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.918925 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.919022 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.919117 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.919201 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.919326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.919428 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.919523 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.919618 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.919735 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.919817 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.919905 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.919991 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.920204 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.920308 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.920446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.920540 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.920629 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.920713 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.920796 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.920881 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.920965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.921063 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.921149 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.921241 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.921335 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.921429 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.921515 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.921598 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.921698 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.921791 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.921886 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.921971 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.922051 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.922122 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.922193 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.922263 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.922347 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.922419 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.922498 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.922569 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.922665 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.922747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.923475 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.923595 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.923699 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.923788 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.923861 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.923940 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.924043 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.924119 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.924204 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.924283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.924363 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.924595 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.924901 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.925213 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.925516 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.925607 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.925823 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.925927 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.926129 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.926231 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.926434 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.926615 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.926723 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.927048 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.927189 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.927359 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.927667 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.927768 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.927974 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.928271 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.928367 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.928640 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.928742 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.928946 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.929049 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.929344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.929492 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.929677 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.929779 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.929993 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.930093 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.930319 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.930424 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.930632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.930738 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.930949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.931041 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.931272 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.931366 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.931579 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.931674 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.931896 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.931998 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.932242 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.932346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.932556 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.932656 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.932885 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.932979 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.933241 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.933365 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.933517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.933620 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.933834 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.933935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.934149 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.934253 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.934473 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.934568 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.934799 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.934900 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.935118 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.935220 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.935436 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.935570 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.935747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.935842 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.936104 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.936208 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.936440 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.936546 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.936764 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.936869 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.937086 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.937189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.937404 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.937498 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.937734 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 03:18:10.937838 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.938053 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.938145 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.938372 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.938474 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.938688 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.938790 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.938999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.939093 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.939311 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.939406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.939623 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.939735 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.939930 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.940045 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.940284 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.940491 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.940655 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.940818 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.940980 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.941140 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.941276 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.941373 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.941493 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.941669 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.941811 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.941915 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.942119 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.942245 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.942555 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.942663 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.942874 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.942968 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.943206 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.943347 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.943503 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.943603 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.943832 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.943924 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.944181 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.944292 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.944511 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.944606 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.944850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.944943 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.945178 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.945307 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.945497 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.945590 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.945898 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.945999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.946237 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.946406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.946513 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.946643 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.946817 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.947125 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.947441 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.947769 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.947934 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.948104 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.948327 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.948433 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.948731 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.948847 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.949055 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.949362 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.949470 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.949686 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.949985 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.950093 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.950407 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.950497 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.951060 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.951177 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.951274 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.951373 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.951509 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.951603 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.951826 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.951919 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.952177 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.952274 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.952503 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.952609 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.952830 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.952933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.953141 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.953236 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.953459 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.953560 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.953773 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.953867 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.954099 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.954194 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.954423 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.954516 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.954739 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.954832 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.955056 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.955158 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.955369 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.955510 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.955709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.955843 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.956039 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.956147 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.956364 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.956491 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.956680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.956792 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.957004 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.957109 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.957323 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.957519 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.957660 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.957839 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.958000 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.958167 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.958323 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.958496 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.958684 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.958828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.958975 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.959177 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.959319 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.959492 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.959645 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.959806 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.959920 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.960137 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.960236 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.960468 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.960638 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.960779 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.960925 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.961069 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.961238 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.961378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.961531 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.961681 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.961830 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.961979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.962168 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.962336 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.962497 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.962659 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.962809 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.962948 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.963101 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.963254 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.963392 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.963496 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.963635 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.963787 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.963930 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.964668 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.964768 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.964982 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.965098 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.965307 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.965503 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.965623 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.965749 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.965921 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.966081 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.966228 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.966427 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.966658 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.966756 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.967003 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.967096 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.967314 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.967416 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.967637 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.967733 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.967971 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.968101 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.968328 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.968500 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.968691 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.968817 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.968966 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.969140 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.969295 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.969615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.969937 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.970260 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.970414 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.970566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.970754 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.970877 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.971169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.971301 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.971481 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.971739 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.971898 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.972201 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.972304 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.972516 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.972811 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.972912 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.973118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.973227 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.973424 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.973557 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.973748 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.973882 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.974126 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.974222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.974453 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.974555 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.974764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.974873 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.975074 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.975169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.975383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.975533 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.975712 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.975862 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.976102 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.976250 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.976389 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.976603 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.976728 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.976943 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.977106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.977284 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.977379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.977617 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.977720 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.977949 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.978053 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.978276 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.978371 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.978602 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.978704 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.978924 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.979017 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.979246 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.979347 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.979568 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.979678 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.980492 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.980621 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.980938 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.981064 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.981171 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.981271 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.981485 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.981643 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.981812 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.981915 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.982203 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.982319 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.982526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.982638 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.982856 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.983094 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.983213 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.983435 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.983541 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.983757 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.983860 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.984103 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.984228 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.984423 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.984526 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.984744 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.984848 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.985065 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.985244 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.985383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.985517 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.985785 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.985904 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.985994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.986095 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.986314 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.986427 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.986648 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.986759 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.986974 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.987071 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.987303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.987406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.987644 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.987759 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.987966 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.988091 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.988314 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.988410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.988635 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.988730 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.988986 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.989089 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.989335 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.989591 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.989760 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.989928 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.990081 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.990259 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.990415 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.990569 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.990724 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.990903 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.991085 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.991208 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.991357 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.991522 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.991685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.991863 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.992059 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.992167 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.992260 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.992492 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.992804 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.993130 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.993308 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.993482 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.993707 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.993877 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.994035 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.994160 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.994384 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.994497 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.994701 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.994993 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.995105 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.995346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.995602 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.995883 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.996104 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.996270 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.996445 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.996544 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.996781 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.996876 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.997114 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.997242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.997452 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.997556 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.997801 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.997974 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.998153 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.998341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.998500 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.998672 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.998833 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.999030 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.999188 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.999368 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.999524 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.999692 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:10.999863 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.000074 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.000216 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.000334 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.000425 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.000520 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.000615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.000701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.000915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.001126 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.001285 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.001488 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.001764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.001903 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.002235 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.002560 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.002891 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.003220 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.003543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.003800 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.004172 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.004273 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.004523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.004679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.004846 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.005004 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.005178 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.005347 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.005504 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.005666 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.005813 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.006057 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.006220 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.006378 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.006614 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.006787 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.007017 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.007204 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.007379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.007556 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.007710 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.007870 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.007998 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.008159 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.008249 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.008341 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.008341 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.008569 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.008665 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.008823 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.008971 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.009135 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.009298 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.009441 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.009602 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.009758 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.009930 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.010070 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.010259 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.010379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.010672 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.011058 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.011151 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.011252 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.011356 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.011597 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.012115 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.012357 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.012677 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.012986 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.013447 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.013669 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.013996 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.014091 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.014309 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.014415 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.014615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.014742 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.014934 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.015095 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.015246 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.015455 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.015577 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.015818 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.016041 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.016357 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.016551 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.016738 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.016914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.017050 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.017456 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.017608 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.017913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.018080 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.018305 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.018488 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.018649 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.018757 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.018963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.019094 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.019273 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.019424 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.019657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.019766 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.019976 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.020176 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.020337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.020486 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.020646 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.020782 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.020926 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.021045 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.021228 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.021367 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.021543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.021769 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.021908 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.022039 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.022262 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.022625 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.022817 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.022958 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.023093 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.023226 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.023360 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.023503 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.023638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.023782 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.023925 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.024088 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.024224 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.024394 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.024533 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.024669 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.024803 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.024946 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.025081 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.025229 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.025372 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.025519 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.025649 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.025780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.025964 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.026137 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.026266 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.026436 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.027166 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.027314 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.027422 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.027635 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.027795 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.027952 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.028146 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.028295 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.028482 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.028617 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.028852 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.028953 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.029113 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.029244 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.029541 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.029644 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.029861 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.029956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.030188 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.030310 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.030510 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.030613 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.030823 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.030922 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.031139 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.031250 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.031454 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.031557 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.031776 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.032067 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.032230 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.032381 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.032550 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.032750 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.032938 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.033074 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.033218 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.033363 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.033509 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.033659 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.033804 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.033948 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.034094 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.034230 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.034362 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.034495 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.034639 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.034782 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.034928 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.035062 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.035195 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.035336 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.035469 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.035609 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.035752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.035921 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.036116 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.036262 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.036417 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.036554 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.036689 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.036866 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.037137 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.037472 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.037639 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.037811 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.037958 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.038124 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.038308 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.038541 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.038770 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.039052 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.039302 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.039772 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.039920 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.040096 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.040222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.040330 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.040428 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.040524 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.040524 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.040678 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.040814 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.040814 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.040985 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.041080 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.041266 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.041407 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.041587 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.041887 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.042059 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.042158 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.042268 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.042437 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.043061 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.043263 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.043440 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.043582 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.043769 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.043903 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.044113 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.044251 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.044442 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.044571 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.044758 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.044907 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.045084 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.045230 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.045412 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.045550 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.045737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.045869 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.046052 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.046188 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.046391 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.046548 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.046708 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.046845 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.047089 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.047242 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.047333 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.047700 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.047807 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.047912 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.048040 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.048177 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.048282 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.048504 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.048681 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.048830 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.048926 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.049157 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.049316 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.049471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.049647 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.049799 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.049972 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.050122 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.050300 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.050452 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.050621 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.050766 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.051020 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.051199 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.051362 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.051496 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.051641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.051772 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.052034 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.052160 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.052311 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.052422 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.052628 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.052724 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.052947 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.053099 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.053271 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.053433 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.053591 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.053687 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.053912 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.054005 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.054236 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.054342 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.054557 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.054652 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.054880 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.055028 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.055202 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.055369 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.055513 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.055658 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.055836 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.055984 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.056226 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.056372 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.056523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.056686 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.056836 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.056976 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.057141 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.057305 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.057450 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 03:18:11.057570 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.057856 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.058141 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.058468 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.058783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.059105 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.059424 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.059748 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.060086 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.060541 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.060859 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.061184 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.061511 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.061834 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.062156 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.062486 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.063044 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.063590 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.064376 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.065446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.065446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.065446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.065772 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.066094 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.066426 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.066767 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.067086 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.067409 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.067736 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.068087 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.068407 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.068743 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.069173 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.069499 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.069829 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.070265 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.070588 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.070908 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.071241 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.071598 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.071907 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.072274 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.072602 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.072921 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.073256 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.074134 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.074460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.074787 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.075103 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.075439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.075773 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.076200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.076540 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.076975 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.077310 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.077656 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.078090 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.078301 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.078619 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.078935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.079257 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.079574 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.079891 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.080267 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.080667 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.080921 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.081251 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.081573 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.081925 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.082214 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_db.sqlalchemy.engines [None req-9d07732f-b2b7-4d38-8ad7-c4b46e14f525 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:18:11.082424 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.082668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.082861 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.083144 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.083471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.083803 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.084305 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.084480 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.084789 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.085108 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.085427 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.085752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.086111 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.086714 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.087255 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.087842 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.088395 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.088744 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.089126 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.089997 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.090348 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.090680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.091012 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.091348 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.091667 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.091986 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.092326 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.092645 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.092963 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.093277 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.093597 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.093913 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.094226 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.094542 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.094874 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.095190 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.095522 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.095839 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.096182 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.096499 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.096909 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.097265 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.097580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.097925 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.098260 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.098589 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.098930 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.099252 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.099586 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.099918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.100282 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.100612 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.100942 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.101268 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.101595 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.101928 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.102248 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.102576 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.102905 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.103233 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.103805 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.104174 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.104591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.104858 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.105184 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.105512 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.105837 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.106159 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.106484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.106806 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.107128 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.107470 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.107802 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.108216 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.108506 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.108833 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.109160 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.109637 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.110207 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.110837 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.111332 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.112391 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.112391 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.112391 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.112740 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.113071 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.113397 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.113727 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.114052 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.114374 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.114737 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.115019 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.115345 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.115682 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.116048 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.116380 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.116708 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.117034 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.117365 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.117908 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.118233 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.118578 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.118912 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.119245 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.119573 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.119901 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.120299 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.120622 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.120939 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.121262 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.121583 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.121900 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.122232 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.122553 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.122868 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.123200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.123515 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.124092 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.124459 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.124880 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.125133 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.125472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.125803 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.126122 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.126456 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.126775 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.127092 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.127421 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.127745 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.128089 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.128408 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.128739 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.129062 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.129380 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.129705 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.130018 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.130365 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.130681 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.130996 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.131303 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.131623 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.131939 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.132280 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.132595 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.132902 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.133225 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.133539 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.133858 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.134171 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.134494 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.134807 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.135123 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.135490 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.135821 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.136700 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.137014 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.137340 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.137661 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.138009 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.138317 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.138642 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.139070 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.139325 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.139886 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.140264 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.140603 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.140955 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.141299 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.141619 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.141938 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.142258 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.142593 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.142920 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.143240 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.143559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.143878 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.144232 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.144555 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.144879 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.145197 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.145513 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.145832 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.146151 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.146465 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.146788 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.147138 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.147468 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.147796 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.148095 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.context [None req-9d07732f-b2b7-4d38-8ad7-c4b46e14f525 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e40af967-83ea-437d-8987-bd41fe271b3a(cell1) {{(pid=117399) load_cells /opt/stack/nova/nova/context.py:464}} May 10 03:18:11.148285 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.148460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.148779 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.149100 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.149419 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.149736 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.150065 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.150406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.150735 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.151051 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.151486 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.152409 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.152740 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.153075 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.153200 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9d07732f-b2b7-4d38-8ad7-c4b46e14f525 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:11.153408 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.153722 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.154053 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.154376 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.154673 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9d07732f-b2b7-4d38-8ad7-c4b46e14f525 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:11.154772 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.155012 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.155353 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.155469 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9d07732f-b2b7-4d38-8ad7-c4b46e14f525 None None] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:11.155700 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.156056 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.156400 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.156714 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.157031 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.157344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.157494 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9d07732f-b2b7-4d38-8ad7-c4b46e14f525 None None] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:11.157655 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.157975 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.158297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.158610 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.158922 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.159241 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.159554 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.159866 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.160202 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.160610 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.160930 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.161244 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.161557 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.161869 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.162180 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.162493 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.162804 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.163201 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.164108 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.164108 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.164358 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.164456 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.165003 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.165347 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.165695 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.166019 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.166355 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.166679 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.167011 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.167363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.167695 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.168097 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.168420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.168691 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.168876 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_db.sqlalchemy.engines [None req-9d07732f-b2b7-4d38-8ad7-c4b46e14f525 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:18:11.169104 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.169350 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.169678 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.170002 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.170323 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.170651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.170971 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.171077 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_db.sqlalchemy.engines [None req-9d07732f-b2b7-4d38-8ad7-c4b46e14f525 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:18:11.171312 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.171650 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.171967 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.172328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.172659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.172991 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.173317 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.173641 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.173981 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.174305 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.174622 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.174949 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.175274 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.175594 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.175924 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.176278 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.176616 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.176953 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.177290 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.177626 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.177984 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.178304 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.178740 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.179077 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.180203 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.180683 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.180918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 03:18:11.181090 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 03:18:11.205414 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_db.sqlalchemy.engines [None req-3d4b3dfd-be21-4b45-ab56-33ea86dcea8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117400) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:18:11.274020 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.context [None req-3d4b3dfd-be21-4b45-ab56-33ea86dcea8d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e40af967-83ea-437d-8987-bd41fe271b3a(cell1) {{(pid=117400) load_cells /opt/stack/nova/nova/context.py:464}} May 10 03:18:11.279160 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3d4b3dfd-be21-4b45-ab56-33ea86dcea8d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:11.280766 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3d4b3dfd-be21-4b45-ab56-33ea86dcea8d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:11.281575 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3d4b3dfd-be21-4b45-ab56-33ea86dcea8d None None] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:11.283508 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3d4b3dfd-be21-4b45-ab56-33ea86dcea8d None None] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:11.296128 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_db.sqlalchemy.engines [None req-3d4b3dfd-be21-4b45-ab56-33ea86dcea8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117400) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:18:11.298222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_db.sqlalchemy.engines [None req-3d4b3dfd-be21-4b45-ab56-33ea86dcea8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117400) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:18:11.332604 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_db.sqlalchemy.engines [None req-9d07732f-b2b7-4d38-8ad7-c4b46e14f525 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:18:11.468547 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_db.sqlalchemy.engines [None req-3d4b3dfd-be21-4b45-ab56-33ea86dcea8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117400) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 03:18:11.647659 dv-cinder-830094-4-smb devstack@n-api.service[117399]: WARNING keystonemiddleware.auth_token [None req-9d07732f-b2b7-4d38-8ad7-c4b46e14f525 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 03:18:11.655322 dv-cinder-830094-4-smb devstack@n-api.service[117399]: WARNING keystonemiddleware.auth_token [None req-9d07732f-b2b7-4d38-8ad7-c4b46e14f525 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 03:18:11.787497 dv-cinder-830094-4-smb devstack@n-api.service[117400]: WARNING keystonemiddleware.auth_token [None req-3d4b3dfd-be21-4b45-ab56-33ea86dcea8d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 03:18:11.796435 dv-cinder-830094-4-smb devstack@n-api.service[117400]: WARNING keystonemiddleware.auth_token [None req-3d4b3dfd-be21-4b45-ab56-33ea86dcea8d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 03:18:11.996283 dv-cinder-830094-4-smb devstack@n-api.service[117399]: WARNING keystonemiddleware.auth_token [None req-9d07732f-b2b7-4d38-8ad7-c4b46e14f525 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 03:18:12.002409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: WARNING keystonemiddleware.auth_token [None req-9d07732f-b2b7-4d38-8ad7-c4b46e14f525 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 03:18:12.007773 dv-cinder-830094-4-smb devstack@n-api.service[117399]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560b1ab099c0 pid: 117399 (default app) May 10 03:18:12.134479 dv-cinder-830094-4-smb devstack@n-api.service[117400]: WARNING keystonemiddleware.auth_token [None req-3d4b3dfd-be21-4b45-ab56-33ea86dcea8d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 03:18:12.141113 dv-cinder-830094-4-smb devstack@n-api.service[117400]: WARNING keystonemiddleware.auth_token [None req-3d4b3dfd-be21-4b45-ab56-33ea86dcea8d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 03:18:12.146407 dv-cinder-830094-4-smb devstack@n-api.service[117400]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560b1ab099c0 pid: 117400 (default app) May 10 03:18:56.117893 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-be13a997-42ce-455d-9c33-ad862ef88db7 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Action: 'create', calling method: .version_select at 0x7f6a5fb5c280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-530810792"}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:56.707488 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-b4278bb8-35c0-41e9-b37e-3986b28324e0 tempest-VolumesTestJSON-622411245 tempest-VolumesTestJSON-622411245-project] Calling method '.version_select at 0x7f6a5fb84f70>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:57.050154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-b4278bb8-35c0-41e9-b37e-3986b28324e0 tempest-VolumesTestJSON-622411245 tempest-VolumesTestJSON-622411245-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/84cf08fc-8a58-421f-8835-3c02c6b9a2e4" status: 200 len: 350 microversion: 2.1 time: 0.674553 May 10 03:18:57.056852 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 1/1] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 03:18:56 2022] GET /compute/v2.1/os-volumes/84cf08fc-8a58-421f-8835-3c02c6b9a2e4 => generated 350 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:18:57.379841 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-be13a997-42ce-455d-9c33-ad862ef88db7 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.806130 May 10 03:18:57.380521 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 1/2] 10.222.0.65 () {60 vars in 1154 bytes} [Tue May 10 03:18:55 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1808 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 03:18:57.393329 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-fa2b4efc-3545-49a3-a7c9-66ab54a78661 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Calling method '.version_select at 0x7f6a5fa22280>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:57.477262 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-fa2b4efc-3545-49a3-a7c9-66ab54a78661 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f31ffd83-6143-41e1-8c0b-a9db924e4094" status: 200 len: 344 microversion: 2.1 time: 0.087463 May 10 03:18:57.482909 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 03:18:57 2022] GET /compute/v2.1/os-volumes/f31ffd83-6143-41e1-8c0b-a9db924e4094 => generated 344 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:18:57.882823 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-0ab5c190-e0df-42ac-ab00-0341ba88ab70 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1118162788", "imageRef": "7ce6e103-a571-4b59-9162-ff1107650c97", "flavorRef": "452", "networks": [{"uuid": "fbad14a4-3a4e-46f8-9724-f3ebd085b788"}]}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:58.013722 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.network.neutron [None req-0ab5c190-e0df-42ac-ab00-0341ba88ab70 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] validate_networks() for [('fbad14a4-3a4e-46f8-9724-f3ebd085b788', None, None, None, None, None)] {{(pid=117399) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:18:58.490141 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-daf93394-6400-4083-ab1a-91e37fe2f640 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Calling method '.version_select at 0x7f6a5fa229d0>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:58.544330 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-daf93394-6400-4083-ab1a-91e37fe2f640 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f31ffd83-6143-41e1-8c0b-a9db924e4094" status: 200 len: 345 microversion: 2.1 time: 0.056306 May 10 03:18:58.544330 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 3/4] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 03:18:58 2022] GET /compute/v2.1/os-volumes/f31ffd83-6143-41e1-8c0b-a9db924e4094 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:18:58.555016 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-1439c2b6-597c-4dbd-b389-18c8f590f353 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Action: 'create', calling method: .version_select at 0x7f6a5fa22af0>, body: {"snapshot": {"volume_id": "f31ffd83-6143-41e1-8c0b-a9db924e4094", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-488287201"}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:18:59.132628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-1439c2b6-597c-4dbd-b389-18c8f590f353 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] 10.222.0.65 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.581519 May 10 03:18:59.139235 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 4/5] 10.222.0.65 () {60 vars in 1161 bytes} [Tue May 10 03:18:58 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:18:59.145508 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-e41bdd0c-d466-4282-8516-8d7be1e15d37 tempest-VolumesTestJSON-622411245 tempest-VolumesTestJSON-622411245-project] Calling method '.version_select at 0x7f6a5fa22e50>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:59.216744 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-e41bdd0c-d466-4282-8516-8d7be1e15d37 tempest-VolumesTestJSON-622411245 tempest-VolumesTestJSON-622411245-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/a285b997-383c-49d2-9aef-98cfa4d9e713" status: 200 len: 351 microversion: 2.1 time: 0.074623 May 10 03:18:59.223670 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 5/6] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 03:18:59 2022] GET /compute/v2.1/os-volumes/a285b997-383c-49d2-9aef-98cfa4d9e713 => generated 351 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:18:59.229413 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-4b24b8f4-d794-4565-a130-24cb73442823 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Calling method '.version_select at 0x7f6a5fa22040>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:59.313785 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-4b24b8f4-d794-4565-a130-24cb73442823 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/8e1b4b5e-33e8-4ea5-a438-5d19667c111a" status: 200 len: 286 microversion: 2.1 time: 0.088439 May 10 03:18:59.320374 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 6/7] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 10 03:18:59 2022] GET /compute/v2.1/os-snapshots/8e1b4b5e-33e8-4ea5-a438-5d19667c111a => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:18:59.326476 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-98024b8a-612f-4b5b-b8ba-8eca123d113c tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Calling method '.version_select at 0x7f6a5fa22820>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:59.393214 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-98024b8a-612f-4b5b-b8ba-8eca123d113c tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.072625 May 10 03:18:59.394083 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 7/8] 10.222.0.65 () {58 vars in 1139 bytes} [Tue May 10 03:18:59 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:18:59.405641 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-b7f54929-ca6a-44de-937d-2de4a2eefce7 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Calling method '.version_select at 0x7f6a5f9b3790>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:18:59.474111 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-b7f54929-ca6a-44de-937d-2de4a2eefce7 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/8e1b4b5e-33e8-4ea5-a438-5d19667c111a" status: 200 len: 286 microversion: 2.1 time: 0.073095 May 10 03:18:59.476053 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 8/9] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 10 03:18:59 2022] GET /compute/v2.1/os-snapshots/8e1b4b5e-33e8-4ea5-a438-5d19667c111a => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:18:59.603670 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-0ab5c190-e0df-42ac-ab00-0341ba88ab70 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Flavor limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:18:59.604915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-0ab5c190-e0df-42ac-ab00-0341ba88ab70 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Image limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:18:59.605594 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-0ab5c190-e0df-42ac-ab00-0341ba88ab70 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Flavor pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:18:59.606164 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-0ab5c190-e0df-42ac-ab00-0341ba88ab70 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Image pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:18:59.606751 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-0ab5c190-e0df-42ac-ab00-0341ba88ab70 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:18:59.621211 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0ab5c190-e0df-42ac-ab00-0341ba88ab70 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:59.621905 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0ab5c190-e0df-42ac-ab00-0341ba88ab70 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:59.623434 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0ab5c190-e0df-42ac-ab00-0341ba88ab70 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:18:59.626904 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0ab5c190-e0df-42ac-ab00-0341ba88ab70 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:18:59.658351 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-0ab5c190-e0df-42ac-ab00-0341ba88ab70 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Getting quotas for project 9244cbe8f30144d984cfc43e3cbb5f4a. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:18:59.672339 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-0ab5c190-e0df-42ac-ab00-0341ba88ab70 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Getting quotas for user 2637ea3672264d8c85cd8c32c1f38423 and project 9244cbe8f30144d984cfc43e3cbb5f4a. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:18:59.686135 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-0ab5c190-e0df-42ac-ab00-0341ba88ab70 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Going to run 1 instances... {{(pid=117399) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:18:59.689769 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-0ab5c190-e0df-42ac-ab00-0341ba88ab70 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ce6e103-a571-4b59-9162-ff1107650c97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:18:59.893729 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-0ab5c190-e0df-42ac-ab00-0341ba88ab70 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.085362 May 10 03:18:59.894381 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 2/10] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 03:18:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:19:00.125386 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a0b599bf-67e4-4b9c-9634-3ca983c374cf tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:00.125386 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-a0b599bf-67e4-4b9c-9634-3ca983c374cf tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:00.125386 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-a0b599bf-67e4-4b9c-9634-3ca983c374cf tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:00.153748 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-a0b599bf-67e4-4b9c-9634-3ca983c374cf tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1215 microversion: 2.1 time: 0.235251 May 10 03:19:00.153748 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 9/11] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:18:59 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1215 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:00.492598 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-b797e070-b58c-4400-9d1d-eea636f6c079 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Calling method '.version_select at 0x7f6a5f0ca3a0>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:00.550856 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-b797e070-b58c-4400-9d1d-eea636f6c079 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/8e1b4b5e-33e8-4ea5-a438-5d19667c111a" status: 200 len: 287 microversion: 2.1 time: 0.064721 May 10 03:19:00.551424 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 3/12] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 10 03:19:00 2022] GET /compute/v2.1/os-snapshots/8e1b4b5e-33e8-4ea5-a438-5d19667c111a => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:00.564629 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-75fe3dee-f470-4ea8-9ed7-09f01c4d238b tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Calling method '.version_select at 0x7f6a5fa22790>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:00.748611 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-75fe3dee-f470-4ea8-9ed7-09f01c4d238b tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] 10.222.0.65 "DELETE /compute/v2.1/os-snapshots/8e1b4b5e-33e8-4ea5-a438-5d19667c111a" status: 202 len: 0 microversion: 2.1 time: 0.187040 May 10 03:19:00.749875 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 10/13] 10.222.0.65 () {58 vars in 1253 bytes} [Tue May 10 03:19:00 2022] DELETE /compute/v2.1/os-snapshots/8e1b4b5e-33e8-4ea5-a438-5d19667c111a => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:19:00.758967 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-bee230ef-37da-47d6-b8e4-8d79e399630b tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Calling method '.version_select at 0x7f6a5f9b2790>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:00.819170 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-bee230ef-37da-47d6-b8e4-8d79e399630b tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/8e1b4b5e-33e8-4ea5-a438-5d19667c111a" status: 200 len: 286 microversion: 2.1 time: 0.064982 May 10 03:19:00.820222 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 4/14] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 10 03:19:00 2022] GET /compute/v2.1/os-snapshots/8e1b4b5e-33e8-4ea5-a438-5d19667c111a => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:01.150651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a14a8ac6-c805-46a6-b7b7-523fe9fb6034 tempest-VolumesTestJSON-622411245 tempest-VolumesTestJSON-622411245-project] Calling method '.version_select at 0x7f6a5f98a1f0>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:01.159661 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-daf84f1e-c0c0-4ced-9df3-ed1ff61d57a8 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:01.160650 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-daf84f1e-c0c0-4ced-9df3-ed1ff61d57a8 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:01.283782 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-a14a8ac6-c805-46a6-b7b7-523fe9fb6034 tempest-VolumesTestJSON-622411245 tempest-VolumesTestJSON-622411245-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/970a4396-d650-4dcf-90a1-01277b741030" status: 200 len: 351 microversion: 2.1 time: 0.138555 May 10 03:19:01.311167 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 11/15] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 03:19:01 2022] GET /compute/v2.1/os-volumes/970a4396-d650-4dcf-90a1-01277b741030 => generated 351 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:01.321390 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-2a4bde43-1911-4c38-8cb4-caa4b5e55922 tempest-VolumesTestJSON-622411245 tempest-VolumesTestJSON-622411245-project] Calling method '.version_select at 0x7f6a5f98a700>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:01.497073 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-daf84f1e-c0c0-4ced-9df3-ed1ff61d57a8 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:01.583588 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-daf84f1e-c0c0-4ced-9df3-ed1ff61d57a8 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1215 microversion: 2.1 time: 0.429144 May 10 03:19:01.588863 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 5/16] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:01 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1215 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:01.615882 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-2a4bde43-1911-4c38-8cb4-caa4b5e55922 tempest-VolumesTestJSON-622411245 tempest-VolumesTestJSON-622411245-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.300371 May 10 03:19:01.615882 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 12/17] 10.222.0.65 () {58 vars in 1133 bytes} [Tue May 10 03:19:01 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:01.628926 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-68ebcc89-89f9-4397-bf59-ce150b761624 tempest-VolumesTestJSON-622411245 tempest-VolumesTestJSON-622411245-project] Calling method '.version_select at 0x7f6a5f0e4160>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:01.789065 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-68ebcc89-89f9-4397-bf59-ce150b761624 tempest-VolumesTestJSON-622411245 tempest-VolumesTestJSON-622411245-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.164020 May 10 03:19:01.790922 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 6/18] 10.222.0.65 () {58 vars in 1148 bytes} [Tue May 10 03:19:01 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:01.804571 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-099a3cd5-8610-4e57-aa6f-27e882eede3f tempest-VolumesTestJSON-622411245 tempest-VolumesTestJSON-622411245-project] Calling method '.version_select at 0x7f6a5f98a940>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:01.830744 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c0fb58ca-ed17-4066-9d0e-daec2c515727 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Calling method '.version_select at 0x7f6a5f0caee0>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:01.866053 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-c0fb58ca-ed17-4066-9d0e-daec2c515727 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] HTTP exception thrown: Snapshot 8e1b4b5e-33e8-4ea5-a438-5d19667c111a could not be found. May 10 03:19:01.870299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c0fb58ca-ed17-4066-9d0e-daec2c515727 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Request method failure captured: May 10 03:19:01.870299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: GET /compute/v2.1/os-snapshots/8e1b4b5e-33e8-4ea5-a438-5d19667c111a HTTP/1.1 May 10 03:19:01.870299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:19:01.870299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:19:01.870299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:19:01.870299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:19:01.870299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:19:01.870299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:19:01.870299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:19:01.870299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:19:01.870299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedmfMnw7-668ymY-Gr73-kWKTxzXzoOBGxASU_jlWPtuBvhpyfCg9ebWWEVx_mrc9BwtMV9a4wJuklRtHSuyWsoS9hX2IK7h824hN47zVl_DYuXGaVdglBwYgrKoj6XLqbaKc6r02iPRdVDuwJHGeWRy0NKtrIjLGlLGhZyu0h8mkXQ May 10 03:19:01.870299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:19:01.870299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:19:01.870299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:19:01.870299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:19:01.870299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:19:01.870299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:19:01.870299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: 7ce1d1101cc34b40aecd1bae052707a8 May 10 03:19:01.870299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-163724197 May 10 03:19:01.870299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:19:01.870299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:19:01.871363 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_7ce1d1101cc34b40aecd1bae052707a8", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7ce1d1101cc34b40aecd1bae052707a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7ce1d1101cc34b40aecd1bae052707a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/7ce1d1101cc34b40aecd1bae052707a8"}]}] May 10 03:19:01.871363 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-VolumesSnapshotsTestJSON-163724197 May 10 03:19:01.871363 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: 7ce1d1101cc34b40aecd1bae052707a8 May 10 03:19:01.871363 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-163724197 May 10 03:19:01.871363 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-VolumesSnapshotsTestJSON-163724197-project May 10 03:19:01.871363 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:19:01.871363 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:19:01.871363 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: 90f8f0a58bf64bd7af1c132f31a20a58 May 10 03:19:01.871363 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-VolumesSnapshotsTestJSON-163724197-project May 10 03:19:01.871363 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: May 10 03:19:01.871363 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Snapshot 8e1b4b5e-33e8-4ea5-a438-5d19667c111a could not be found. May 10 03:19:01.871363 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': '8e1b4b5e-33e8-4ea5-a438-5d19667c111a'} May 10 03:19:01.871363 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:19:01.872066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:01.872066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 03:19:01.872066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 03:19:01.872066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 03:19:01.872066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 03:19:01.872066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 03:19:01.872066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 03:19:01.872066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 03:19:01.872066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 03:19:01.872066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 03:19:01.872066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 03:19:01.872066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:19:01.872066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:19:01.872066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:19:01.872066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:19:01.872066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8e1b4b5e-33e8-4ea5-a438-5d19667c111a could not be found. (HTTP 404) (Request-ID: req-8e3620b1-6ad2-4f2f-81c3-1f3950370990) May 10 03:19:01.872066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:01.872066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:01.872894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:01.872894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:01.872894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 10 03:19:01.872894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 10 03:19:01.872894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 03:19:01.872894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 03:19:01.872894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 10 03:19:01.872894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 10 03:19:01.872894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 03:19:01.872894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 03:19:01.872894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 03:19:01.872894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 03:19:01.872894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 03:19:01.872894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 03:19:01.872894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 03:19:01.872894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 03:19:01.872894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 03:19:01.872894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 03:19:01.872894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 03:19:01.873714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 03:19:01.873714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:19:01.873714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:19:01.873714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:19:01.873714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:19:01.873714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8e1b4b5e-33e8-4ea5-a438-5d19667c111a could not be found. May 10 03:19:01.873714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:01.873714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:01.873714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:01.873714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:01.873714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:01.873714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:01.873714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:19:01.873714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:19:01.873714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 03:19:01.873714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 03:19:01.873714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:19:01.873714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:19:01.873714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 10 03:19:01.873714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:19:01.880192 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8e1b4b5e-33e8-4ea5-a438-5d19667c111a could not be found. May 10 03:19:01.880192 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:01.880192 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:01.880192 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:01.880192 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:01.880192 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:01.880192 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:01.880192 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:19:01.880192 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:19:01.880192 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8e1b4b5e-33e8-4ea5-a438-5d19667c111a could not be found. May 10 03:19:01.880192 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:01.880192 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c0fb58ca-ed17-4066-9d0e-daec2c515727 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Returning 404 to user: Snapshot 8e1b4b5e-33e8-4ea5-a438-5d19667c111a could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:19:01.880192 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-c0fb58ca-ed17-4066-9d0e-daec2c515727 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/8e1b4b5e-33e8-4ea5-a438-5d19667c111a" status: 404 len: 111 microversion: 2.1 time: 0.044972 May 10 03:19:01.880192 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 7/19] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 10 03:19:01 2022] GET /compute/v2.1/os-snapshots/8e1b4b5e-33e8-4ea5-a438-5d19667c111a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 03:19:01.885885 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-f6933e2b-7814-4668-a9c8-ee0a10c76720 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Calling method '.version_select at 0x7f6a5f93b0d0>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:01.939318 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-099a3cd5-8610-4e57-aa6f-27e882eede3f tempest-VolumesTestJSON-622411245 tempest-VolumesTestJSON-622411245-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.140597 May 10 03:19:01.940317 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 13/20] 10.222.0.65 () {58 vars in 1133 bytes} [Tue May 10 03:19:01 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:01.952420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-b4e89345-ea16-4ec8-98a0-4c5d4676c0a4 tempest-VolumesTestJSON-622411245 tempest-VolumesTestJSON-622411245-project] Calling method '.version_select at 0x7f6a5f98a0d0>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:02.042157 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-b4e89345-ea16-4ec8-98a0-4c5d4676c0a4 tempest-VolumesTestJSON-622411245 tempest-VolumesTestJSON-622411245-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.094015 May 10 03:19:02.043357 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 14/21] 10.222.0.65 () {58 vars in 1166 bytes} [Tue May 10 03:19:01 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:19:02.068160 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a384b2a1-94f6-4806-8646-716955e833fc tempest-VolumesTestJSON-622411245 tempest-VolumesTestJSON-622411245-project] Calling method '.version_select at 0x7f6a5f993280>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:02.206433 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-f6933e2b-7814-4668-a9c8-ee0a10c76720 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/f31ffd83-6143-41e1-8c0b-a9db924e4094" status: 202 len: 0 microversion: 2.1 time: 0.329012 May 10 03:19:02.207074 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 8/22] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 10 03:19:01 2022] DELETE /compute/v2.1/os-volumes/f31ffd83-6143-41e1-8c0b-a9db924e4094 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:19:02.217123 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-b50bcec7-1763-4fcf-bee7-65151de04575 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Calling method '.version_select at 0x7f6a5e83b5e0>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:02.236287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-a384b2a1-94f6-4806-8646-716955e833fc tempest-VolumesTestJSON-622411245 tempest-VolumesTestJSON-622411245-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.174921 May 10 03:19:02.237447 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 15/23] 10.222.0.65 () {58 vars in 1169 bytes} [Tue May 10 03:19:02 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:02.257474 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-908fb393-9892-43a9-9925-a261763d398c tempest-VolumesTestJSON-622411245 tempest-VolumesTestJSON-622411245-project] Calling method '.version_select at 0x7f6a5fa22550>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:02.345682 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-b50bcec7-1763-4fcf-bee7-65151de04575 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f31ffd83-6143-41e1-8c0b-a9db924e4094" status: 200 len: 344 microversion: 2.1 time: 0.134209 May 10 03:19:02.346254 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 9/24] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 03:19:02 2022] GET /compute/v2.1/os-volumes/f31ffd83-6143-41e1-8c0b-a9db924e4094 => generated 344 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:02.417575 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-908fb393-9892-43a9-9925-a261763d398c tempest-VolumesTestJSON-622411245 tempest-VolumesTestJSON-622411245-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.163864 May 10 03:19:02.418757 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 16/25] 10.222.0.65 () {58 vars in 1154 bytes} [Tue May 10 03:19:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:02.431796 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-f31d6298-ee75-4052-8588-e427eb852ac7 tempest-VolumesTestJSON-622411245 tempest-VolumesTestJSON-622411245-project] Calling method '.version_select at 0x7f6a5e83bca0>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:02.605377 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-1f8224c4-b2cd-48ba-ada1-c1fc23ca6fdb tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:02.605999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-1f8224c4-b2cd-48ba-ada1-c1fc23ca6fdb tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:02.609931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-f31d6298-ee75-4052-8588-e427eb852ac7 tempest-VolumesTestJSON-622411245 tempest-VolumesTestJSON-622411245-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.183478 May 10 03:19:02.610513 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 10/26] 10.222.0.65 () {58 vars in 1187 bytes} [Tue May 10 03:19:02 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:02.621867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-520cc659-b19a-4c9b-b313-2eaf387aded6 tempest-VolumesTestJSON-622411245 tempest-VolumesTestJSON-622411245-project] Calling method '.version_select at 0x7f6a5e85b940>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:02.641470 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1f8224c4-b2cd-48ba-ada1-c1fc23ca6fdb tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:02.642071 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1f8224c4-b2cd-48ba-ada1-c1fc23ca6fdb tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:02.643006 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1f8224c4-b2cd-48ba-ada1-c1fc23ca6fdb tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:02.650421 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1f8224c4-b2cd-48ba-ada1-c1fc23ca6fdb tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:02.831251 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-520cc659-b19a-4c9b-b313-2eaf387aded6 tempest-VolumesTestJSON-622411245 tempest-VolumesTestJSON-622411245-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.213028 May 10 03:19:02.843656 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 11/27] 10.222.0.65 () {58 vars in 1154 bytes} [Tue May 10 03:19:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:03.155445 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1f8224c4-b2cd-48ba-ada1-c1fc23ca6fdb tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:03.194369 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-1f8224c4-b2cd-48ba-ada1-c1fc23ca6fdb tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1219 microversion: 2.1 time: 0.593228 May 10 03:19:03.204653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 17/28] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:02 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1219 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:03.361165 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-d78d75a2-6ec3-4322-b4db-fcd884682c78 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Calling method '.version_select at 0x7f6a5e85b670>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:03.440647 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-d78d75a2-6ec3-4322-b4db-fcd884682c78 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] HTTP exception thrown: Volume f31ffd83-6143-41e1-8c0b-a9db924e4094 could not be found. May 10 03:19:03.444534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-d78d75a2-6ec3-4322-b4db-fcd884682c78 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Request method failure captured: May 10 03:19:03.444534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: GET /compute/v2.1/os-volumes/f31ffd83-6143-41e1-8c0b-a9db924e4094 HTTP/1.1 May 10 03:19:03.444534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:19:03.444534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:19:03.444534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:19:03.444534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:19:03.444534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:19:03.444534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:19:03.444534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:19:03.444534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:19:03.444534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedmfMnw7-668ymY-Gr73-kWKTxzXzoOBGxASU_jlWPtuBvhpyfCg9ebWWEVx_mrc9BwtMV9a4wJuklRtHSuyWsoS9hX2IK7h824hN47zVl_DYuXGaVdglBwYgrKoj6XLqbaKc6r02iPRdVDuwJHGeWRy0NKtrIjLGlLGhZyu0h8mkXQ May 10 03:19:03.444534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:19:03.444534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:19:03.444534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:19:03.444534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:19:03.444534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:19:03.444534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:19:03.444534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: 7ce1d1101cc34b40aecd1bae052707a8 May 10 03:19:03.444534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-163724197 May 10 03:19:03.444534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:19:03.444534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:19:03.445618 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_7ce1d1101cc34b40aecd1bae052707a8", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7ce1d1101cc34b40aecd1bae052707a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7ce1d1101cc34b40aecd1bae052707a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/7ce1d1101cc34b40aecd1bae052707a8"}]}] May 10 03:19:03.445618 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-VolumesSnapshotsTestJSON-163724197 May 10 03:19:03.445618 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: 7ce1d1101cc34b40aecd1bae052707a8 May 10 03:19:03.445618 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-163724197 May 10 03:19:03.445618 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-VolumesSnapshotsTestJSON-163724197-project May 10 03:19:03.445618 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:19:03.445618 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:19:03.445618 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: 90f8f0a58bf64bd7af1c132f31a20a58 May 10 03:19:03.445618 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-VolumesSnapshotsTestJSON-163724197-project May 10 03:19:03.445618 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: May 10 03:19:03.445618 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Volume f31ffd83-6143-41e1-8c0b-a9db924e4094 could not be found. May 10 03:19:03.445618 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': 'f31ffd83-6143-41e1-8c0b-a9db924e4094'} May 10 03:19:03.445618 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:19:03.446242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:03.446242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:19:03.446242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:19:03.446242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 03:19:03.446242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 03:19:03.446242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 03:19:03.446242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 03:19:03.446242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 03:19:03.446242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 03:19:03.446242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 03:19:03.446242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 03:19:03.446242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:19:03.446242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:19:03.446242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:19:03.446242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:19:03.446242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f31ffd83-6143-41e1-8c0b-a9db924e4094 could not be found. (HTTP 404) (Request-ID: req-5aea0840-dd5d-42ef-86f6-14edc9a56f83) May 10 03:19:03.446242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:03.446242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:03.446242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:03.447303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:03.447303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 03:19:03.447303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 03:19:03.447303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 03:19:03.447303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 03:19:03.447303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 03:19:03.447303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 03:19:03.447303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 03:19:03.447303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 03:19:03.447303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:19:03.447303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:19:03.447303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 03:19:03.447303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 03:19:03.447303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 03:19:03.447303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 03:19:03.447303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 03:19:03.447303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 03:19:03.447303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 03:19:03.447303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 03:19:03.448236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:19:03.448236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:19:03.448236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:19:03.448236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:19:03.448236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f31ffd83-6143-41e1-8c0b-a9db924e4094 could not be found. May 10 03:19:03.448236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:03.448236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:03.448236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:03.448236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:03.448236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:03.448236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:03.448236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:19:03.448236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:19:03.448236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 03:19:03.448236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 03:19:03.448236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:19:03.448236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:19:03.448236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 03:19:03.448236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:19:03.449080 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f31ffd83-6143-41e1-8c0b-a9db924e4094 could not be found. May 10 03:19:03.449080 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:03.449080 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:03.449080 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:03.449080 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:03.449080 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:03.449080 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:03.449080 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:19:03.449080 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:19:03.449080 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f31ffd83-6143-41e1-8c0b-a9db924e4094 could not be found. May 10 03:19:03.449080 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:03.469879 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-d78d75a2-6ec3-4322-b4db-fcd884682c78 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Returning 404 to user: Volume f31ffd83-6143-41e1-8c0b-a9db924e4094 could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:19:03.469879 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-d78d75a2-6ec3-4322-b4db-fcd884682c78 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f31ffd83-6143-41e1-8c0b-a9db924e4094" status: 404 len: 109 microversion: 2.1 time: 0.112721 May 10 03:19:03.469879 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 12/29] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 03:19:03 2022] GET /compute/v2.1/os-volumes/f31ffd83-6143-41e1-8c0b-a9db924e4094 => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:19:03.490499 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-0db27d4e-5642-4082-b36b-a9debd90d4b4 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Calling method '.version_select at 0x7f6a5f8fa9d0>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:03.549467 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-0db27d4e-5642-4082-b36b-a9debd90d4b4 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] HTTP exception thrown: Volume f31ffd83-6143-41e1-8c0b-a9db924e4094 could not be found. May 10 03:19:03.556471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-0db27d4e-5642-4082-b36b-a9debd90d4b4 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Request method failure captured: May 10 03:19:03.556471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: DELETE /compute/v2.1/os-volumes/f31ffd83-6143-41e1-8c0b-a9db924e4094 HTTP/1.1 May 10 03:19:03.556471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:19:03.556471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:19:03.556471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:19:03.556471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:19:03.556471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:19:03.556471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:19:03.556471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:19:03.556471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:19:03.556471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedmfMnw7-668ymY-Gr73-kWKTxzXzoOBGxASU_jlWPtuBvhpyfCg9ebWWEVx_mrc9BwtMV9a4wJuklRtHSuyWsoS9hX2IK7h824hN47zVl_DYuXGaVdglBwYgrKoj6XLqbaKc6r02iPRdVDuwJHGeWRy0NKtrIjLGlLGhZyu0h8mkXQ May 10 03:19:03.556471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:19:03.556471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:19:03.556471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:19:03.556471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:19:03.556471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:19:03.556471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:19:03.556471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: 7ce1d1101cc34b40aecd1bae052707a8 May 10 03:19:03.556471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-163724197 May 10 03:19:03.556471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:19:03.556471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:19:03.562491 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_7ce1d1101cc34b40aecd1bae052707a8", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7ce1d1101cc34b40aecd1bae052707a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7ce1d1101cc34b40aecd1bae052707a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/7ce1d1101cc34b40aecd1bae052707a8"}]}] May 10 03:19:03.562491 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-VolumesSnapshotsTestJSON-163724197 May 10 03:19:03.562491 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: 7ce1d1101cc34b40aecd1bae052707a8 May 10 03:19:03.562491 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-163724197 May 10 03:19:03.562491 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-VolumesSnapshotsTestJSON-163724197-project May 10 03:19:03.562491 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:19:03.562491 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:19:03.562491 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: 90f8f0a58bf64bd7af1c132f31a20a58 May 10 03:19:03.562491 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-VolumesSnapshotsTestJSON-163724197-project May 10 03:19:03.562491 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: May 10 03:19:03.562491 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Volume f31ffd83-6143-41e1-8c0b-a9db924e4094 could not be found. May 10 03:19:03.562491 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'id': 'f31ffd83-6143-41e1-8c0b-a9db924e4094'} May 10 03:19:03.562491 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:19:03.563222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:03.563222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:19:03.563222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:19:03.563222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 03:19:03.563222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 03:19:03.563222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 03:19:03.563222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 03:19:03.563222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 03:19:03.563222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 03:19:03.563222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 03:19:03.563222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 03:19:03.563222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:19:03.563222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:19:03.563222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:19:03.563222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:19:03.563222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f31ffd83-6143-41e1-8c0b-a9db924e4094 could not be found. (HTTP 404) (Request-ID: req-1a83fa70-e476-4632-b727-f9dd083eba67) May 10 03:19:03.563222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:19:03.563222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:03.563222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:19:03.564232 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:03.564232 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 03:19:03.564232 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 03:19:03.564232 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 03:19:03.564232 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 03:19:03.564232 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 03:19:03.564232 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 03:19:03.564232 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 03:19:03.564232 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 03:19:03.564232 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:19:03.564232 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:19:03.564232 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 03:19:03.564232 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 03:19:03.564232 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 03:19:03.564232 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 03:19:03.564232 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 03:19:03.564232 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 03:19:03.564232 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 03:19:03.564232 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 03:19:03.565097 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:19:03.565097 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:19:03.565097 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:19:03.565097 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:19:03.565097 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f31ffd83-6143-41e1-8c0b-a9db924e4094 could not be found. May 10 03:19:03.565097 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:19:03.565097 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:03.565097 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:19:03.565097 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:03.565097 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:03.565097 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:03.565097 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:19:03.565097 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:19:03.565097 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 03:19:03.565097 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 03:19:03.565097 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:19:03.565097 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:19:03.565097 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 03:19:03.565097 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:19:03.568301 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f31ffd83-6143-41e1-8c0b-a9db924e4094 could not be found. May 10 03:19:03.568301 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:19:03.568301 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:03.568301 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:19:03.568301 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:03.568301 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:03.568301 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:03.568301 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:19:03.568301 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:19:03.568301 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f31ffd83-6143-41e1-8c0b-a9db924e4094 could not be found. May 10 03:19:03.568301 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:19:03.568301 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-0db27d4e-5642-4082-b36b-a9debd90d4b4 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Returning 404 to user: Volume f31ffd83-6143-41e1-8c0b-a9db924e4094 could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:19:03.568301 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-0db27d4e-5642-4082-b36b-a9debd90d4b4 tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/f31ffd83-6143-41e1-8c0b-a9db924e4094" status: 404 len: 109 microversion: 2.1 time: 0.076277 May 10 03:19:03.568301 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 18/30] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 10 03:19:03 2022] DELETE /compute/v2.1/os-volumes/f31ffd83-6143-41e1-8c0b-a9db924e4094 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:19:03.570047 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-af821492-6403-40f6-a12a-8e7549516e1b tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Calling method '.version_select at 0x7f6a5e83bc10>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:03.612611 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-af821492-6403-40f6-a12a-8e7549516e1b tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] HTTP exception thrown: Volume f31ffd83-6143-41e1-8c0b-a9db924e4094 could not be found. May 10 03:19:03.614737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-af821492-6403-40f6-a12a-8e7549516e1b tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Request method failure captured: May 10 03:19:03.614737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: GET /compute/v2.1/os-volumes/f31ffd83-6143-41e1-8c0b-a9db924e4094 HTTP/1.1 May 10 03:19:03.614737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:19:03.614737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:19:03.614737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:19:03.614737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:19:03.614737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:19:03.614737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:19:03.614737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:19:03.614737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:19:03.614737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedmfMnw7-668ymY-Gr73-kWKTxzXzoOBGxASU_jlWPtuBvhpyfCg9ebWWEVx_mrc9BwtMV9a4wJuklRtHSuyWsoS9hX2IK7h824hN47zVl_DYuXGaVdglBwYgrKoj6XLqbaKc6r02iPRdVDuwJHGeWRy0NKtrIjLGlLGhZyu0h8mkXQ May 10 03:19:03.614737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:19:03.614737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:19:03.614737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:19:03.614737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:19:03.614737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:19:03.614737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:19:03.614737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: 7ce1d1101cc34b40aecd1bae052707a8 May 10 03:19:03.614737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-163724197 May 10 03:19:03.614737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:19:03.614737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:19:03.615967 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_7ce1d1101cc34b40aecd1bae052707a8", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7ce1d1101cc34b40aecd1bae052707a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7ce1d1101cc34b40aecd1bae052707a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/7ce1d1101cc34b40aecd1bae052707a8"}]}] May 10 03:19:03.615967 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-VolumesSnapshotsTestJSON-163724197 May 10 03:19:03.615967 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: 7ce1d1101cc34b40aecd1bae052707a8 May 10 03:19:03.615967 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-163724197 May 10 03:19:03.615967 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-VolumesSnapshotsTestJSON-163724197-project May 10 03:19:03.615967 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:19:03.615967 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:19:03.615967 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: 90f8f0a58bf64bd7af1c132f31a20a58 May 10 03:19:03.615967 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-VolumesSnapshotsTestJSON-163724197-project May 10 03:19:03.615967 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: May 10 03:19:03.615967 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Volume f31ffd83-6143-41e1-8c0b-a9db924e4094 could not be found. May 10 03:19:03.615967 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': 'f31ffd83-6143-41e1-8c0b-a9db924e4094'} May 10 03:19:03.615967 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:19:03.618940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:03.618940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:19:03.618940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:19:03.618940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 03:19:03.618940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 03:19:03.618940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 03:19:03.618940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 03:19:03.618940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 03:19:03.618940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 03:19:03.618940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 03:19:03.618940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 03:19:03.618940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:19:03.618940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:19:03.618940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:19:03.618940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:19:03.618940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f31ffd83-6143-41e1-8c0b-a9db924e4094 could not be found. (HTTP 404) (Request-ID: req-2a093603-94d4-46ba-a0ec-17b074f1d159) May 10 03:19:03.618940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:03.618940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:03.618940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:03.620106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:03.620106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 03:19:03.620106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 03:19:03.620106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 03:19:03.620106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 03:19:03.620106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 03:19:03.620106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 03:19:03.620106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 03:19:03.620106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 03:19:03.620106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:19:03.620106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:19:03.620106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 03:19:03.620106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 03:19:03.620106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 03:19:03.620106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 03:19:03.620106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 03:19:03.620106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 03:19:03.620106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 03:19:03.620106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 03:19:03.621189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:19:03.621189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:19:03.621189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:19:03.621189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:19:03.621189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f31ffd83-6143-41e1-8c0b-a9db924e4094 could not be found. May 10 03:19:03.621189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:03.621189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:03.621189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:03.621189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:03.621189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:03.621189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:03.621189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:19:03.621189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:19:03.621189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 03:19:03.621189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 03:19:03.621189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:19:03.621189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:19:03.621189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 03:19:03.621189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:19:03.623200 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f31ffd83-6143-41e1-8c0b-a9db924e4094 could not be found. May 10 03:19:03.623200 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:03.623200 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:03.623200 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:03.623200 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:03.623200 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:03.623200 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:03.623200 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:19:03.623200 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:19:03.623200 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f31ffd83-6143-41e1-8c0b-a9db924e4094 could not be found. May 10 03:19:03.623200 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:03.623200 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-af821492-6403-40f6-a12a-8e7549516e1b tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] Returning 404 to user: Volume f31ffd83-6143-41e1-8c0b-a9db924e4094 could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:19:03.623200 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-af821492-6403-40f6-a12a-8e7549516e1b tempest-VolumesSnapshotsTestJSON-163724197 tempest-VolumesSnapshotsTestJSON-163724197-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f31ffd83-6143-41e1-8c0b-a9db924e4094" status: 404 len: 109 microversion: 2.1 time: 0.051910 May 10 03:19:03.623200 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 13/31] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 03:19:03 2022] GET /compute/v2.1/os-volumes/f31ffd83-6143-41e1-8c0b-a9db924e4094 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:19:04.211200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-3e367a43-a8ca-47f3-94d5-6e8e6e52ee6d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:04.218590 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-3e367a43-a8ca-47f3-94d5-6e8e6e52ee6d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:04.222060 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3e367a43-a8ca-47f3-94d5-6e8e6e52ee6d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:04.222988 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3e367a43-a8ca-47f3-94d5-6e8e6e52ee6d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:04.224116 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3e367a43-a8ca-47f3-94d5-6e8e6e52ee6d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:04.225351 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3e367a43-a8ca-47f3-94d5-6e8e6e52ee6d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:04.596662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-3e367a43-a8ca-47f3-94d5-6e8e6e52ee6d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:04.607871 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-3e367a43-a8ca-47f3-94d5-6e8e6e52ee6d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1267 microversion: 2.1 time: 0.400289 May 10 03:19:04.612982 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 19/32] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:04 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1267 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:05.637163 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-62bc5d29-e325-43b0-94de-bc4741c934d4 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:05.638325 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-62bc5d29-e325-43b0-94de-bc4741c934d4 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:05.661399 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-62bc5d29-e325-43b0-94de-bc4741c934d4 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:05.666433 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-62bc5d29-e325-43b0-94de-bc4741c934d4 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:05.666433 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-62bc5d29-e325-43b0-94de-bc4741c934d4 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:05.666433 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-62bc5d29-e325-43b0-94de-bc4741c934d4 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:06.020359 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-62bc5d29-e325-43b0-94de-bc4741c934d4 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:06.051090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-62bc5d29-e325-43b0-94de-bc4741c934d4 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1273 microversion: 2.1 time: 0.422200 May 10 03:19:06.052992 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 14/33] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:05 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1273 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:07.072981 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-bd30da64-17eb-4424-9908-429d7e0dd0b8 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:07.073521 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-bd30da64-17eb-4424-9908-429d7e0dd0b8 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:07.093019 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bd30da64-17eb-4424-9908-429d7e0dd0b8 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:07.101361 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bd30da64-17eb-4424-9908-429d7e0dd0b8 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:07.102210 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bd30da64-17eb-4424-9908-429d7e0dd0b8 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:07.102704 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bd30da64-17eb-4424-9908-429d7e0dd0b8 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:07.968763 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-bd30da64-17eb-4424-9908-429d7e0dd0b8 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:07.980709 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-bd30da64-17eb-4424-9908-429d7e0dd0b8 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1273 microversion: 2.1 time: 0.915837 May 10 03:19:07.987610 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 20/34] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:07 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1273 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:09.002150 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ef46131a-38e6-4037-9935-a9c5b49d29ec tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:09.003425 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ef46131a-38e6-4037-9935-a9c5b49d29ec tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:09.013274 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ef46131a-38e6-4037-9935-a9c5b49d29ec tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:09.022186 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ef46131a-38e6-4037-9935-a9c5b49d29ec tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:09.023966 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ef46131a-38e6-4037-9935-a9c5b49d29ec tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:09.026879 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ef46131a-38e6-4037-9935-a9c5b49d29ec tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:09.425139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ef46131a-38e6-4037-9935-a9c5b49d29ec tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:09.453985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ef46131a-38e6-4037-9935-a9c5b49d29ec tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1273 microversion: 2.1 time: 0.453540 May 10 03:19:09.470108 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 15/35] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:08 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1273 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:10.473267 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a7886ec4-15a4-494d-a63e-5de0690223bb tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:10.474060 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-a7886ec4-15a4-494d-a63e-5de0690223bb tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:10.488081 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a7886ec4-15a4-494d-a63e-5de0690223bb tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:10.489180 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a7886ec4-15a4-494d-a63e-5de0690223bb tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:10.494777 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a7886ec4-15a4-494d-a63e-5de0690223bb tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:10.498862 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a7886ec4-15a4-494d-a63e-5de0690223bb tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:11.431744 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-919a12b0-948c-4a8b-ab9c-accbeaa3aeca tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Action: 'create', calling method: .version_select at 0x7f6a5e79d9d0>, body: {"keypair": {"name": "tempest-keypair-323377545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKR81iDUWDLL8lrnNqj5QxeCWW5YSyXIivxopOQHoSgQm5Jrqo/qWY6wifW7it8fLR6aJCJ26vSKUFabMIJF9PvhoerbdrLl9itoaNxyyuyGkarscIUfoMPdceD9A4v1OQ=="}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:11.508312 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-919a12b0-948c-4a8b-ab9c-accbeaa3aeca tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Getting quotas for project 813036cfbb6e4f1b93bbf75a982aa96f. Resources: {'key_pairs'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:19:11.517338 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-919a12b0-948c-4a8b-ab9c-accbeaa3aeca tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Getting quotas for user a14e317d371c4f9f994a568798c00e90 and project 813036cfbb6e4f1b93bbf75a982aa96f. Resources: {'key_pairs'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:19:11.665821 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-919a12b0-948c-4a8b-ab9c-accbeaa3aeca tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.918979 May 10 03:19:11.667605 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 16/36] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 10 03:19:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:12.238373 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-a7886ec4-15a4-494d-a63e-5de0690223bb tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:12.248790 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-a7886ec4-15a4-494d-a63e-5de0690223bb tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1315 microversion: 2.1 time: 1.780088 May 10 03:19:12.249373 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 21/37] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:10 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1315 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:13.266446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-6d9d648e-8fd8-4ca9-bd4d-81bd1c319a3c tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:13.267976 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-6d9d648e-8fd8-4ca9-bd4d-81bd1c319a3c tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:13.292678 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6d9d648e-8fd8-4ca9-bd4d-81bd1c319a3c tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:13.312112 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6d9d648e-8fd8-4ca9-bd4d-81bd1c319a3c tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:13.313416 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6d9d648e-8fd8-4ca9-bd4d-81bd1c319a3c tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:13.317129 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6d9d648e-8fd8-4ca9-bd4d-81bd1c319a3c tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:14.608666 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-2284a12e-7f91-4c9c-a59b-3e649d4f246c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Action: 'create', calling method: .version_select at 0x7f6a5f837dc0>, body: {"keypair": {"name": "tempest-keypair-140344405", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdzJqY7iMS2wPFuqhcEn8ciVYmACtezLDOcwWouTJgRBtDBut4yagbTaAy0zZRYngH5/hTI5CUTzOLxYijhGWghbctdrNv7UhEPKDpgW/hUzcTSojiynfcxVcSPiU6M5g=="}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:14.809170 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-2284a12e-7f91-4c9c-a59b-3e649d4f246c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Getting quotas for project 4af328ed59384b70b2312c150a124746. Resources: {'key_pairs'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:19:14.817427 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-2284a12e-7f91-4c9c-a59b-3e649d4f246c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Getting quotas for user 9dff947a164641e7b32c639bebbffe36 and project 4af328ed59384b70b2312c150a124746. Resources: {'key_pairs'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:19:15.057632 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-2284a12e-7f91-4c9c-a59b-3e649d4f246c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.379559 May 10 03:19:15.059495 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 22/38] 10.222.0.65 () {62 vars in 1199 bytes} [Tue May 10 03:19:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1382 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 03:19:15.878658 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-6d9d648e-8fd8-4ca9-bd4d-81bd1c319a3c tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:15.888727 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-6d9d648e-8fd8-4ca9-bd4d-81bd1c319a3c tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1315 microversion: 2.1 time: 2.626253 May 10 03:19:15.904421 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 17/39] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:13 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1315 bytes in 2642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:16.909392 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-8a19af3e-9fef-4ca7-8b85-13093c5e0f55 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:16.909940 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-8a19af3e-9fef-4ca7-8b85-13093c5e0f55 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:16.923276 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8a19af3e-9fef-4ca7-8b85-13093c5e0f55 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:16.923743 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8a19af3e-9fef-4ca7-8b85-13093c5e0f55 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:16.927570 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8a19af3e-9fef-4ca7-8b85-13093c5e0f55 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:16.928107 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8a19af3e-9fef-4ca7-8b85-13093c5e0f55 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:17.742277 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-8a19af3e-9fef-4ca7-8b85-13093c5e0f55 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:17.750530 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-8a19af3e-9fef-4ca7-8b85-13093c5e0f55 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1315 microversion: 2.1 time: 0.845573 May 10 03:19:17.762757 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 23/40] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:16 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1315 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:18.778588 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-8035964f-18b0-46ec-96f1-16e38dba635d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:18.779203 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8035964f-18b0-46ec-96f1-16e38dba635d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:18.793415 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8035964f-18b0-46ec-96f1-16e38dba635d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:18.794631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8035964f-18b0-46ec-96f1-16e38dba635d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:18.797196 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8035964f-18b0-46ec-96f1-16e38dba635d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:18.797654 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8035964f-18b0-46ec-96f1-16e38dba635d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:19.951786 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-0442193e-6df2-414e-903c-8b2ebfb5ee0a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1438288654", "imageRef": "7ce6e103-a571-4b59-9162-ff1107650c97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2381b1f0-2571-49ba-9c52-e5ec6b453c14"}], "security_groups": [{"name": "tempest-securitygroup--25655005"}], "key_name": "tempest-keypair-140344405", "user_data": "}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:20.000105 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8035964f-18b0-46ec-96f1-16e38dba635d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:20.042671 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-8035964f-18b0-46ec-96f1-16e38dba635d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1315 microversion: 2.1 time: 1.268299 May 10 03:19:20.043288 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 18/41] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:18 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1315 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:20.558275 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-53e78c2c-7d34-4f86-a8da-25885adb887a req-b64a165d-a483-4892-b56c-3f5a793c2f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4227840d-36a9-472b-9c4b-984368ce0cea", "tag": "a3b7916c-8ceb-428b-823b-ea9349841f8d"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:20.613463 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-53e78c2c-7d34-4f86-a8da-25885adb887a req-b64a165d-a483-4892-b56c-3f5a793c2f05 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:20.613937 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-53e78c2c-7d34-4f86-a8da-25885adb887a req-b64a165d-a483-4892-b56c-3f5a793c2f05 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:20.679613 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-53e78c2c-7d34-4f86-a8da-25885adb887a req-b64a165d-a483-4892-b56c-3f5a793c2f05 service nova] Creating event network-changed:a3b7916c-8ceb-428b-823b-ea9349841f8d for instance 4227840d-36a9-472b-9c4b-984368ce0cea on hv-cinder-83009 May 10 03:19:20.682833 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-53e78c2c-7d34-4f86-a8da-25885adb887a req-b64a165d-a483-4892-b56c-3f5a793c2f05 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117399) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 03:19:20.685515 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-80d9da53-6321-413b-bbf4-080707b35f9b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:20.706584 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-80d9da53-6321-413b-bbf4-080707b35f9b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:20.715614 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-80d9da53-6321-413b-bbf4-080707b35f9b None None] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:20.716728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.network.neutron [None req-0442193e-6df2-414e-903c-8b2ebfb5ee0a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] validate_networks() for [('2381b1f0-2571-49ba-9c52-e5ec6b453c14', None, None, None, None, None)] {{(pid=117400) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:19:20.717559 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-80d9da53-6321-413b-bbf4-080707b35f9b None None] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:20.730039 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.compute.rpcapi [None req-80d9da53-6321-413b-bbf4-080707b35f9b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 03:19:20.731168 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-80d9da53-6321-413b-bbf4-080707b35f9b None None] Releasing lock "compute-rpcapi-router" {{(pid=117399) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 03:19:20.781402 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-80d9da53-6321-413b-bbf4-080707b35f9b None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.736816 May 10 03:19:20.785076 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 19/42] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:21.171189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-43d89b8f-af80-4e44-8fd7-e90eebf8e0af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1933655680", "imageRef": "7ce6e103-a571-4b59-9162-ff1107650c97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:21.285167 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.network.neutron [None req-43d89b8f-af80-4e44-8fd7-e90eebf8e0af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] validate_networks() for [('5a79d71b-8531-4a1f-830d-d1ccd6b795ac', None, None, None, None, None)] {{(pid=117399) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:19:23.862950 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-43d89b8f-af80-4e44-8fd7-e90eebf8e0af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Flavor limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:19:23.864466 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-43d89b8f-af80-4e44-8fd7-e90eebf8e0af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Image limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:19:23.865317 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-43d89b8f-af80-4e44-8fd7-e90eebf8e0af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Flavor pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:19:23.866084 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-43d89b8f-af80-4e44-8fd7-e90eebf8e0af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Image pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:19:23.866702 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-43d89b8f-af80-4e44-8fd7-e90eebf8e0af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:19:23.884784 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-43d89b8f-af80-4e44-8fd7-e90eebf8e0af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:23.885470 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-43d89b8f-af80-4e44-8fd7-e90eebf8e0af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:23.889008 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-43d89b8f-af80-4e44-8fd7-e90eebf8e0af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:23.889713 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-43d89b8f-af80-4e44-8fd7-e90eebf8e0af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:23.937339 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-43d89b8f-af80-4e44-8fd7-e90eebf8e0af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Getting quotas for project d8e319a149db44fb8bb71f3066c82956. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:19:23.942119 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-43d89b8f-af80-4e44-8fd7-e90eebf8e0af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Getting quotas for user e309fb66a98b407d8b7533207e6a6dfc and project d8e319a149db44fb8bb71f3066c82956. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:19:23.963551 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-43d89b8f-af80-4e44-8fd7-e90eebf8e0af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Going to run 1 instances... {{(pid=117399) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:19:23.967249 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-43d89b8f-af80-4e44-8fd7-e90eebf8e0af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ce6e103-a571-4b59-9162-ff1107650c97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:19:24.013751 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-0442193e-6df2-414e-903c-8b2ebfb5ee0a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Flavor limits 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:19:24.014359 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-0442193e-6df2-414e-903c-8b2ebfb5ee0a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Image limits 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:19:24.014647 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-0442193e-6df2-414e-903c-8b2ebfb5ee0a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Flavor pref 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:19:24.015112 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-0442193e-6df2-414e-903c-8b2ebfb5ee0a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Image pref 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:19:24.015528 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-0442193e-6df2-414e-903c-8b2ebfb5ee0a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:19:24.026151 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0442193e-6df2-414e-903c-8b2ebfb5ee0a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:24.028141 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0442193e-6df2-414e-903c-8b2ebfb5ee0a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:24.028141 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0442193e-6df2-414e-903c-8b2ebfb5ee0a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:24.028141 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0442193e-6df2-414e-903c-8b2ebfb5ee0a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:24.052505 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-0442193e-6df2-414e-903c-8b2ebfb5ee0a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Getting quotas for project 4af328ed59384b70b2312c150a124746. Resources: {'cores', 'instances', 'ram'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:19:24.056880 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-0442193e-6df2-414e-903c-8b2ebfb5ee0a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Getting quotas for user 9dff947a164641e7b32c639bebbffe36 and project 4af328ed59384b70b2312c150a124746. Resources: {'cores', 'instances', 'ram'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:19:24.099662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-0442193e-6df2-414e-903c-8b2ebfb5ee0a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Going to run 1 instances... {{(pid=117400) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:19:24.103118 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-0442193e-6df2-414e-903c-8b2ebfb5ee0a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ce6e103-a571-4b59-9162-ff1107650c97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:19:24.163503 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-43d89b8f-af80-4e44-8fd7-e90eebf8e0af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.380054 May 10 03:19:24.173562 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 20/43] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 03:19:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 3391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:19:24.188212 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-dcc6c6d3-8ca9-4e0b-9830-c04839536dec tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:24.188879 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-dcc6c6d3-8ca9-4e0b-9830-c04839536dec tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:24.205975 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dcc6c6d3-8ca9-4e0b-9830-c04839536dec tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:24.206437 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dcc6c6d3-8ca9-4e0b-9830-c04839536dec tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:24.210991 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dcc6c6d3-8ca9-4e0b-9830-c04839536dec tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:24.210991 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dcc6c6d3-8ca9-4e0b-9830-c04839536dec tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:24.381472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-0442193e-6df2-414e-903c-8b2ebfb5ee0a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 4.435379 May 10 03:19:24.383153 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 24/44] 10.222.0.65 () {62 vars in 1187 bytes} [Tue May 10 03:19:19 2022] POST /compute/v2.1/servers => generated 400 bytes in 4438 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 10 03:19:24.393720 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-cd98d2b6-e233-41f3-9f39-ceca47692b06 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2052616522", "imageRef": "7ce6e103-a571-4b59-9162-ff1107650c97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7cb49c2b-d8b7-49df-956b-d47b255b5450"}], "security_groups": [{"name": "tempest-securitygroup--2007682115"}], "key_name": "tempest-keypair-323377545", "user_data": "}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:24.968757 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.network.neutron [None req-cd98d2b6-e233-41f3-9f39-ceca47692b06 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] validate_networks() for [('7cb49c2b-d8b7-49df-956b-d47b255b5450', None, None, None, None, None)] {{(pid=117400) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:19:25.077228 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-dcc6c6d3-8ca9-4e0b-9830-c04839536dec tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:25.088224 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-dcc6c6d3-8ca9-4e0b-9830-c04839536dec tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1315 microversion: 2.1 time: 0.913236 May 10 03:19:25.089820 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 21/45] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:24 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1315 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:25.483711 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-dec643af-cd2e-4a7f-b2da-a8819075ea9d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Action: 'create', calling method: .version_select at 0x7f6a5e757b80>, body: {"keypair": {"name": "tempest-keypair-885825858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7HAc+mSertWWnEZiE4IgUa6Hqm0nc8b6BqbljVuEmgyrnmeM3RZeadg1M8JQdhzNpK0JBtinkQIzaO/zYkblQv07dkQ1FY+FixEEiTKT0tlBueBS5w8NDfWpx3aONuxA=="}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:25.527960 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-dec643af-cd2e-4a7f-b2da-a8819075ea9d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Getting quotas for project 0b7c607953b94c02977d60c0b0536e24. Resources: {'key_pairs'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:19:25.557605 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-dec643af-cd2e-4a7f-b2da-a8819075ea9d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Getting quotas for user 9407e88fdbd74ba196ffd9fd221e15f5 and project 0b7c607953b94c02977d60c0b0536e24. Resources: {'key_pairs'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:19:25.735342 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-dec643af-cd2e-4a7f-b2da-a8819075ea9d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.633180 May 10 03:19:25.742378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 22/46] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 10 03:19:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:25.750965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-68496813-df8e-4e50-9ccf-d57a655c60e6 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:25.751655 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-68496813-df8e-4e50-9ccf-d57a655c60e6 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:25.908511 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-68496813-df8e-4e50-9ccf-d57a655c60e6 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:25.919846 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-68496813-df8e-4e50-9ccf-d57a655c60e6 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1222 microversion: 2.1 time: 0.177550 May 10 03:19:25.933988 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 23/47] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:25 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1222 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:25.947321 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-f9396ddf-9cd7-43e7-958d-2498ab3f0fcd tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:25.948340 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-f9396ddf-9cd7-43e7-958d-2498ab3f0fcd tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:26.174111 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-f9396ddf-9cd7-43e7-958d-2498ab3f0fcd tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:26.202715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-f9396ddf-9cd7-43e7-958d-2498ab3f0fcd tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:26.206019 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-f9396ddf-9cd7-43e7-958d-2498ab3f0fcd tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:26.211129 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-f9396ddf-9cd7-43e7-958d-2498ab3f0fcd tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1281 microversion: 2.20 time: 0.270055 May 10 03:19:26.214806 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 24/48] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:19:25 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1281 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:26.227160 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-cd98d2b6-e233-41f3-9f39-ceca47692b06 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Flavor limits 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:19:26.227624 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-cd98d2b6-e233-41f3-9f39-ceca47692b06 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Image limits 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:19:26.229327 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-cd98d2b6-e233-41f3-9f39-ceca47692b06 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Flavor pref 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:19:26.230534 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-cd98d2b6-e233-41f3-9f39-ceca47692b06 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Image pref 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:19:26.230981 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-cd98d2b6-e233-41f3-9f39-ceca47692b06 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:19:26.247482 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-1762eb05-26bb-4900-a640-60cada6f116a tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:26.249311 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-1762eb05-26bb-4900-a640-60cada6f116a tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:26.252289 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cd98d2b6-e233-41f3-9f39-ceca47692b06 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:26.255174 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cd98d2b6-e233-41f3-9f39-ceca47692b06 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:26.257341 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cd98d2b6-e233-41f3-9f39-ceca47692b06 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:26.258005 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cd98d2b6-e233-41f3-9f39-ceca47692b06 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:26.265643 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1762eb05-26bb-4900-a640-60cada6f116a tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:26.267168 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1762eb05-26bb-4900-a640-60cada6f116a tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:26.269936 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1762eb05-26bb-4900-a640-60cada6f116a tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:26.270396 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1762eb05-26bb-4900-a640-60cada6f116a tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:26.321941 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-cd98d2b6-e233-41f3-9f39-ceca47692b06 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Getting quotas for project 813036cfbb6e4f1b93bbf75a982aa96f. Resources: {'cores', 'instances', 'ram'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:19:26.338094 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-cd98d2b6-e233-41f3-9f39-ceca47692b06 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Getting quotas for user a14e317d371c4f9f994a568798c00e90 and project 813036cfbb6e4f1b93bbf75a982aa96f. Resources: {'cores', 'instances', 'ram'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:19:26.371030 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-cd98d2b6-e233-41f3-9f39-ceca47692b06 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Going to run 1 instances... {{(pid=117400) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:19:26.371030 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-cd98d2b6-e233-41f3-9f39-ceca47692b06 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ce6e103-a571-4b59-9162-ff1107650c97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:19:26.576693 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-cd98d2b6-e233-41f3-9f39-ceca47692b06 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.191689 May 10 03:19:26.581926 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 25/49] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 03:19:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 2198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:19:26.587552 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-0b6abe81-c0b8-4f1d-b994-21359c8c5290 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-738848812", "imageRef": "7ce6e103-a571-4b59-9162-ff1107650c97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:26.605843 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-1762eb05-26bb-4900-a640-60cada6f116a tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:26.618811 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-1762eb05-26bb-4900-a640-60cada6f116a tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1315 microversion: 2.1 time: 0.402509 May 10 03:19:26.631575 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 25/50] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:26 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:26.651014 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-2855b4b8-0985-4c90-bc54-523ef45c2b9e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:26.656126 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-2855b4b8-0985-4c90-bc54-523ef45c2b9e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:26.745933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.network.neutron [None req-0b6abe81-c0b8-4f1d-b994-21359c8c5290 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] validate_networks() for [('5a79d71b-8531-4a1f-830d-d1ccd6b795ac', None, None, None, None, None)] {{(pid=117400) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:19:26.998468 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-2855b4b8-0985-4c90-bc54-523ef45c2b9e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:27.019110 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-2855b4b8-0985-4c90-bc54-523ef45c2b9e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1237 microversion: 2.1 time: 0.385653 May 10 03:19:27.025957 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 26/51] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:26 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1237 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:27.238584 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ad4bf8b1-6718-4dfe-acd4-62e9e5e58a46 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:27.239504 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ad4bf8b1-6718-4dfe-acd4-62e9e5e58a46 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:27.263882 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ad4bf8b1-6718-4dfe-acd4-62e9e5e58a46 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:27.265633 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ad4bf8b1-6718-4dfe-acd4-62e9e5e58a46 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:27.268222 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ad4bf8b1-6718-4dfe-acd4-62e9e5e58a46 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:27.275951 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ad4bf8b1-6718-4dfe-acd4-62e9e5e58a46 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:27.427492 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ad4bf8b1-6718-4dfe-acd4-62e9e5e58a46 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:27.464079 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ad4bf8b1-6718-4dfe-acd4-62e9e5e58a46 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:27.466660 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ad4bf8b1-6718-4dfe-acd4-62e9e5e58a46 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:27.468062 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ad4bf8b1-6718-4dfe-acd4-62e9e5e58a46 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1285 microversion: 2.20 time: 0.235382 May 10 03:19:27.468707 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 27/52] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:19:27 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1285 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:19:27.627904 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-0b6abe81-c0b8-4f1d-b994-21359c8c5290 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Flavor limits 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:19:27.628496 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-0b6abe81-c0b8-4f1d-b994-21359c8c5290 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Image limits 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:19:27.628836 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-0b6abe81-c0b8-4f1d-b994-21359c8c5290 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Flavor pref 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:19:27.630119 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-0b6abe81-c0b8-4f1d-b994-21359c8c5290 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Image pref 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:19:27.630561 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-0b6abe81-c0b8-4f1d-b994-21359c8c5290 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:19:27.638089 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-3b51ad30-8679-4a4d-9deb-8fab728db49d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:27.639018 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-3b51ad30-8679-4a4d-9deb-8fab728db49d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:27.641699 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0b6abe81-c0b8-4f1d-b994-21359c8c5290 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:27.642524 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0b6abe81-c0b8-4f1d-b994-21359c8c5290 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:27.643742 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0b6abe81-c0b8-4f1d-b994-21359c8c5290 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:27.644373 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0b6abe81-c0b8-4f1d-b994-21359c8c5290 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:27.653131 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3b51ad30-8679-4a4d-9deb-8fab728db49d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:27.653590 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3b51ad30-8679-4a4d-9deb-8fab728db49d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:27.654383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3b51ad30-8679-4a4d-9deb-8fab728db49d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:27.654825 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3b51ad30-8679-4a4d-9deb-8fab728db49d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:27.667823 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-0b6abe81-c0b8-4f1d-b994-21359c8c5290 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Getting quotas for project d8e319a149db44fb8bb71f3066c82956. Resources: {'cores', 'instances', 'ram'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:19:27.682883 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-0b6abe81-c0b8-4f1d-b994-21359c8c5290 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Getting quotas for user e309fb66a98b407d8b7533207e6a6dfc and project d8e319a149db44fb8bb71f3066c82956. Resources: {'cores', 'instances', 'ram'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:19:27.732203 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-0b6abe81-c0b8-4f1d-b994-21359c8c5290 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Going to run 1 instances... {{(pid=117400) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:19:27.732203 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-0b6abe81-c0b8-4f1d-b994-21359c8c5290 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ce6e103-a571-4b59-9162-ff1107650c97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:19:27.816266 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-3b51ad30-8679-4a4d-9deb-8fab728db49d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:27.828051 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-3b51ad30-8679-4a4d-9deb-8fab728db49d tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1315 microversion: 2.1 time: 0.193652 May 10 03:19:27.829737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 28/53] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:27 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:28.040881 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-46ac5951-e1a7-44b1-a7b6-3f0ac3d53be4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:28.041509 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-46ac5951-e1a7-44b1-a7b6-3f0ac3d53be4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:28.093555 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-46ac5951-e1a7-44b1-a7b6-3f0ac3d53be4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:28.100140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-46ac5951-e1a7-44b1-a7b6-3f0ac3d53be4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1237 microversion: 2.1 time: 0.064188 May 10 03:19:28.100707 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 29/54] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:28 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1237 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:28.206199 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-0b6abe81-c0b8-4f1d-b994-21359c8c5290 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.622811 May 10 03:19:28.210800 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 26/55] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 03:19:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:19:28.221061 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-aaea6b75-d431-43ab-9057-d2d7b5dbdd1d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:28.222705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-aaea6b75-d431-43ab-9057-d2d7b5dbdd1d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:28.342579 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-aaea6b75-d431-43ab-9057-d2d7b5dbdd1d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:28.354630 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-aaea6b75-d431-43ab-9057-d2d7b5dbdd1d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1221 microversion: 2.1 time: 0.139641 May 10 03:19:28.356202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 30/56] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:28 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1221 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:28.501015 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-705060b3-7d08-4dbf-bbcf-042e3cabcdec tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:28.501631 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-705060b3-7d08-4dbf-bbcf-042e3cabcdec tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:28.510856 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-705060b3-7d08-4dbf-bbcf-042e3cabcdec tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:28.515560 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-705060b3-7d08-4dbf-bbcf-042e3cabcdec tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:28.515560 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-705060b3-7d08-4dbf-bbcf-042e3cabcdec tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:28.515560 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-705060b3-7d08-4dbf-bbcf-042e3cabcdec tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:28.706423 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-705060b3-7d08-4dbf-bbcf-042e3cabcdec tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:28.715959 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-705060b3-7d08-4dbf-bbcf-042e3cabcdec tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:28.727178 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-705060b3-7d08-4dbf-bbcf-042e3cabcdec tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:28.735604 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-705060b3-7d08-4dbf-bbcf-042e3cabcdec tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1277 microversion: 2.20 time: 0.239560 May 10 03:19:28.740318 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 27/57] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:19:28 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1277 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:28.848207 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-0b4f62b7-5154-4bdf-ba7c-e7b26f684412 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:28.856183 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-0b4f62b7-5154-4bdf-ba7c-e7b26f684412 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:28.862120 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0b4f62b7-5154-4bdf-ba7c-e7b26f684412 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:28.862622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0b4f62b7-5154-4bdf-ba7c-e7b26f684412 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:28.863485 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0b4f62b7-5154-4bdf-ba7c-e7b26f684412 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:28.864245 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0b4f62b7-5154-4bdf-ba7c-e7b26f684412 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:29.032312 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-0b4f62b7-5154-4bdf-ba7c-e7b26f684412 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:29.042155 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-0b4f62b7-5154-4bdf-ba7c-e7b26f684412 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1315 microversion: 2.1 time: 0.199553 May 10 03:19:29.042964 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 31/58] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:28 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:29.117162 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a38028e5-03fc-48fc-b9fa-04193d025031 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:29.117790 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-a38028e5-03fc-48fc-b9fa-04193d025031 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:29.210340 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-a38028e5-03fc-48fc-b9fa-04193d025031 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:29.223857 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-a38028e5-03fc-48fc-b9fa-04193d025031 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1237 microversion: 2.1 time: 0.110412 May 10 03:19:29.224774 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 28/59] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:29 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1237 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:29.372843 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ef196850-c66c-4dc0-a0d7-2eab13d589c9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:29.373642 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ef196850-c66c-4dc0-a0d7-2eab13d589c9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:29.555791 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ef196850-c66c-4dc0-a0d7-2eab13d589c9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:29.567454 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ef196850-c66c-4dc0-a0d7-2eab13d589c9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1221 microversion: 2.1 time: 0.198480 May 10 03:19:29.568052 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 32/60] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:29 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1221 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:29.758018 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-24c1d4be-6b61-42cb-9a0e-3a78b0e3fede tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:29.759541 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-24c1d4be-6b61-42cb-9a0e-3a78b0e3fede tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:29.774898 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-24c1d4be-6b61-42cb-9a0e-3a78b0e3fede tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:29.775630 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-24c1d4be-6b61-42cb-9a0e-3a78b0e3fede tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:29.776709 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-24c1d4be-6b61-42cb-9a0e-3a78b0e3fede tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:29.778905 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-24c1d4be-6b61-42cb-9a0e-3a78b0e3fede tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:30.058984 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-91fb947e-d86d-4aa5-b824-fa7a674896d1 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:30.059782 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-91fb947e-d86d-4aa5-b824-fa7a674896d1 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:30.066398 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-91fb947e-d86d-4aa5-b824-fa7a674896d1 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:30.075265 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-91fb947e-d86d-4aa5-b824-fa7a674896d1 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:30.076202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-91fb947e-d86d-4aa5-b824-fa7a674896d1 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:30.076648 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-91fb947e-d86d-4aa5-b824-fa7a674896d1 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:30.214264 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-24c1d4be-6b61-42cb-9a0e-3a78b0e3fede tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:30.214264 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-24c1d4be-6b61-42cb-9a0e-3a78b0e3fede tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:30.215747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-24c1d4be-6b61-42cb-9a0e-3a78b0e3fede tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:30.216901 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-24c1d4be-6b61-42cb-9a0e-3a78b0e3fede tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1341 microversion: 2.20 time: 0.465025 May 10 03:19:30.232116 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 29/61] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:19:29 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1341 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:30.256110 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-9b19ac83-1b9f-42fb-8061-9542f02d88e9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:30.256110 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-9b19ac83-1b9f-42fb-8061-9542f02d88e9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:30.272496 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9b19ac83-1b9f-42fb-8061-9542f02d88e9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:30.273163 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9b19ac83-1b9f-42fb-8061-9542f02d88e9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:30.274035 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9b19ac83-1b9f-42fb-8061-9542f02d88e9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:30.274437 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9b19ac83-1b9f-42fb-8061-9542f02d88e9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:30.407367 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-9b19ac83-1b9f-42fb-8061-9542f02d88e9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:30.419121 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-9b19ac83-1b9f-42fb-8061-9542f02d88e9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1289 microversion: 2.1 time: 0.172894 May 10 03:19:30.429821 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 30/62] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:30 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1289 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:30.469180 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-91fb947e-d86d-4aa5-b824-fa7a674896d1 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:30.478482 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-91fb947e-d86d-4aa5-b824-fa7a674896d1 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1315 microversion: 2.1 time: 0.423686 May 10 03:19:30.481202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 33/63] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:30 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:30.587367 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-bc8aa559-354e-4859-b76e-f9e5903c23cc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:30.601263 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-bc8aa559-354e-4859-b76e-f9e5903c23cc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:30.618341 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bc8aa559-354e-4859-b76e-f9e5903c23cc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:30.629303 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bc8aa559-354e-4859-b76e-f9e5903c23cc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:30.630536 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bc8aa559-354e-4859-b76e-f9e5903c23cc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:30.631791 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bc8aa559-354e-4859-b76e-f9e5903c23cc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:30.819277 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-bc8aa559-354e-4859-b76e-f9e5903c23cc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:30.832556 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-bc8aa559-354e-4859-b76e-f9e5903c23cc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1273 microversion: 2.1 time: 0.243626 May 10 03:19:30.832556 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 31/64] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:30 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1273 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:31.259457 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-78dd70a5-68f3-4d46-8247-fec261094253 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:31.260485 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-78dd70a5-68f3-4d46-8247-fec261094253 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:31.287994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-78dd70a5-68f3-4d46-8247-fec261094253 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:31.288486 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-78dd70a5-68f3-4d46-8247-fec261094253 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:31.296804 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-78dd70a5-68f3-4d46-8247-fec261094253 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:31.297650 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-78dd70a5-68f3-4d46-8247-fec261094253 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:31.428323 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-78dd70a5-68f3-4d46-8247-fec261094253 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:31.443139 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-b7c63fae-dbdf-4728-a345-6caaa40b550a req-b9482e80-13cf-41a4-b443-b5444be8e086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4227840d-36a9-472b-9c4b-984368ce0cea", "name": "network-vif-plugged", "status": "completed", "tag": "a3b7916c-8ceb-428b-823b-ea9349841f8d"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:31.443914 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-78dd70a5-68f3-4d46-8247-fec261094253 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:31.448908 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-78dd70a5-68f3-4d46-8247-fec261094253 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:31.448908 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-78dd70a5-68f3-4d46-8247-fec261094253 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1339 microversion: 2.20 time: 0.192730 May 10 03:19:31.449092 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 34/65] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:19:31 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1339 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:19:31.457692 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-b7c63fae-dbdf-4728-a345-6caaa40b550a req-b9482e80-13cf-41a4-b443-b5444be8e086 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:31.458355 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-b7c63fae-dbdf-4728-a345-6caaa40b550a req-b9482e80-13cf-41a4-b443-b5444be8e086 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:31.459161 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-6c2782d8-e544-4af9-8cbd-052afc82e091 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:31.463962 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-6c2782d8-e544-4af9-8cbd-052afc82e091 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:31.477409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6c2782d8-e544-4af9-8cbd-052afc82e091 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:31.477939 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6c2782d8-e544-4af9-8cbd-052afc82e091 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:31.478723 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6c2782d8-e544-4af9-8cbd-052afc82e091 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:31.479221 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6c2782d8-e544-4af9-8cbd-052afc82e091 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:31.491452 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-b7c63fae-dbdf-4728-a345-6caaa40b550a req-b9482e80-13cf-41a4-b443-b5444be8e086 service nova] Creating event network-vif-plugged:a3b7916c-8ceb-428b-823b-ea9349841f8d for instance 4227840d-36a9-472b-9c4b-984368ce0cea on hv-cinder-83009 May 10 03:19:31.491994 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-b7c63fae-dbdf-4728-a345-6caaa40b550a req-b9482e80-13cf-41a4-b443-b5444be8e086 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117400) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 03:19:31.493731 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-33e9173b-f99e-4bff-9f6b-29752c48b210 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:31.494169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-33e9173b-f99e-4bff-9f6b-29752c48b210 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:31.494950 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-33e9173b-f99e-4bff-9f6b-29752c48b210 None None] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:31.495380 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-33e9173b-f99e-4bff-9f6b-29752c48b210 None None] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:31.508625 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.compute.rpcapi [None req-33e9173b-f99e-4bff-9f6b-29752c48b210 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 03:19:31.509557 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-33e9173b-f99e-4bff-9f6b-29752c48b210 None None] Releasing lock "compute-rpcapi-router" {{(pid=117400) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 03:19:31.571247 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-33e9173b-f99e-4bff-9f6b-29752c48b210 None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255839 May 10 03:19:31.572739 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 32/66] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:19:31.585022 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-cca4c739-18c4-4346-81e9-bf63dc7a97c6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-811120193", "imageRef": "7ce6e103-a571-4b59-9162-ff1107650c97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1e0211ea-07f5-489a-bffd-a2279bfba53a"}], "security_groups": [{"name": "tempest-securitygroup--971005637"}], "key_name": "tempest-keypair-885825858", "user_data": "}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:31.722350 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-6c2782d8-e544-4af9-8cbd-052afc82e091 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:31.732099 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-6c2782d8-e544-4af9-8cbd-052afc82e091 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1307 microversion: 2.1 time: 0.281886 May 10 03:19:31.737505 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 35/67] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:31 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1307 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:31.751100 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-720e99a4-9a3c-427b-baea-7bbdbc679884 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:31.751884 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-720e99a4-9a3c-427b-baea-7bbdbc679884 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:31.759858 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-720e99a4-9a3c-427b-baea-7bbdbc679884 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:31.760541 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-720e99a4-9a3c-427b-baea-7bbdbc679884 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:31.761521 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-720e99a4-9a3c-427b-baea-7bbdbc679884 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:31.762092 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-720e99a4-9a3c-427b-baea-7bbdbc679884 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:31.903659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.network.neutron [None req-cca4c739-18c4-4346-81e9-bf63dc7a97c6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] validate_networks() for [('1e0211ea-07f5-489a-bffd-a2279bfba53a', None, None, None, None, None)] {{(pid=117400) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:19:32.285355 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-720e99a4-9a3c-427b-baea-7bbdbc679884 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:32.296734 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-720e99a4-9a3c-427b-baea-7bbdbc679884 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1315 microversion: 2.1 time: 0.557915 May 10 03:19:32.301148 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 36/68] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:31 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:32.326242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-7cb9a860-0ee3-40cf-9b67-81c2ed2fc9fb tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:32.332082 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-7cb9a860-0ee3-40cf-9b67-81c2ed2fc9fb tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:32.344090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7cb9a860-0ee3-40cf-9b67-81c2ed2fc9fb tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:32.344643 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7cb9a860-0ee3-40cf-9b67-81c2ed2fc9fb tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:32.345518 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7cb9a860-0ee3-40cf-9b67-81c2ed2fc9fb tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:32.346052 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7cb9a860-0ee3-40cf-9b67-81c2ed2fc9fb tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:32.477873 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-7cb9a860-0ee3-40cf-9b67-81c2ed2fc9fb tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:32.485511 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-7cb9a860-0ee3-40cf-9b67-81c2ed2fc9fb tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1279 microversion: 2.1 time: 0.171221 May 10 03:19:32.495865 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 37/69] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:32 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1279 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:32.500144 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-9a729cf6-cf37-4b35-8292-7043e5206185 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:32.500969 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-9a729cf6-cf37-4b35-8292-7043e5206185 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:32.508755 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9a729cf6-cf37-4b35-8292-7043e5206185 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:32.509409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9a729cf6-cf37-4b35-8292-7043e5206185 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:32.510339 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9a729cf6-cf37-4b35-8292-7043e5206185 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:32.510921 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9a729cf6-cf37-4b35-8292-7043e5206185 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:32.693423 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-9a729cf6-cf37-4b35-8292-7043e5206185 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:32.701719 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-9a729cf6-cf37-4b35-8292-7043e5206185 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:32.705664 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-9a729cf6-cf37-4b35-8292-7043e5206185 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:32.711859 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-9a729cf6-cf37-4b35-8292-7043e5206185 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1339 microversion: 2.20 time: 0.220992 May 10 03:19:32.715462 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 38/70] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:19:32 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1339 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:32.756590 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a132607c-181e-4cb1-a6cb-096169554a85 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:32.757039 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-a132607c-181e-4cb1-a6cb-096169554a85 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:32.763853 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a132607c-181e-4cb1-a6cb-096169554a85 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:32.766741 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a132607c-181e-4cb1-a6cb-096169554a85 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:32.768679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a132607c-181e-4cb1-a6cb-096169554a85 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:32.770021 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a132607c-181e-4cb1-a6cb-096169554a85 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:32.940696 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-a132607c-181e-4cb1-a6cb-096169554a85 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:32.953619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-a132607c-181e-4cb1-a6cb-096169554a85 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1295 microversion: 2.1 time: 0.200606 May 10 03:19:32.964302 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 39/71] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:32 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1295 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:33.099669 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-cca4c739-18c4-4346-81e9-bf63dc7a97c6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Flavor limits 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:19:33.100142 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-cca4c739-18c4-4346-81e9-bf63dc7a97c6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Image limits 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:19:33.100596 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-cca4c739-18c4-4346-81e9-bf63dc7a97c6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Flavor pref 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:19:33.101003 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-cca4c739-18c4-4346-81e9-bf63dc7a97c6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Image pref 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:19:33.101415 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-cca4c739-18c4-4346-81e9-bf63dc7a97c6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:19:33.121131 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cca4c739-18c4-4346-81e9-bf63dc7a97c6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:33.121979 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cca4c739-18c4-4346-81e9-bf63dc7a97c6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:33.128664 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cca4c739-18c4-4346-81e9-bf63dc7a97c6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:33.130324 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cca4c739-18c4-4346-81e9-bf63dc7a97c6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:33.171646 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-cca4c739-18c4-4346-81e9-bf63dc7a97c6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Getting quotas for project 0b7c607953b94c02977d60c0b0536e24. Resources: {'cores', 'instances', 'ram'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:19:33.176959 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-cca4c739-18c4-4346-81e9-bf63dc7a97c6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Getting quotas for user 9407e88fdbd74ba196ffd9fd221e15f5 and project 0b7c607953b94c02977d60c0b0536e24. Resources: {'cores', 'instances', 'ram'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:19:33.208325 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-cca4c739-18c4-4346-81e9-bf63dc7a97c6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Going to run 1 instances... {{(pid=117400) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:19:33.233550 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-cca4c739-18c4-4346-81e9-bf63dc7a97c6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ce6e103-a571-4b59-9162-ff1107650c97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:19:33.323809 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-791a843a-312c-4cc5-b7f7-b63a98811fcf tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:33.326369 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-791a843a-312c-4cc5-b7f7-b63a98811fcf tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:33.356702 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-791a843a-312c-4cc5-b7f7-b63a98811fcf tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:33.357279 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-791a843a-312c-4cc5-b7f7-b63a98811fcf tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:33.360239 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-791a843a-312c-4cc5-b7f7-b63a98811fcf tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:33.361590 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-791a843a-312c-4cc5-b7f7-b63a98811fcf tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:33.369963 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-cca4c739-18c4-4346-81e9-bf63dc7a97c6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.794765 May 10 03:19:33.381784 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 33/72] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 03:19:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 1808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:19:33.391783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-55a4ca68-5856-4c36-9bb1-7629038c2767 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:33.392777 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-55a4ca68-5856-4c36-9bb1-7629038c2767 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:33.574165 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-55a4ca68-5856-4c36-9bb1-7629038c2767 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:33.588377 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-55a4ca68-5856-4c36-9bb1-7629038c2767 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1240 microversion: 2.1 time: 0.203110 May 10 03:19:33.591357 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 34/73] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:33 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1240 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:33.612865 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-d6023b96-a7ca-414a-ab75-8dc385b3e87c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:33.614414 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-d6023b96-a7ca-414a-ab75-8dc385b3e87c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:33.628710 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d6023b96-a7ca-414a-ab75-8dc385b3e87c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:33.629431 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d6023b96-a7ca-414a-ab75-8dc385b3e87c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:33.630845 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d6023b96-a7ca-414a-ab75-8dc385b3e87c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:33.635722 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d6023b96-a7ca-414a-ab75-8dc385b3e87c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:34.006274 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-791a843a-312c-4cc5-b7f7-b63a98811fcf tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:34.028815 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-791a843a-312c-4cc5-b7f7-b63a98811fcf tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1315 microversion: 2.1 time: 0.705352 May 10 03:19:34.028815 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 40/74] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:33 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1315 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:34.037792 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-7b01ccb4-1002-4e21-8f96-788fd650bee1 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:34.039010 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-7b01ccb4-1002-4e21-8f96-788fd650bee1 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:34.061510 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7b01ccb4-1002-4e21-8f96-788fd650bee1 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:34.063588 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7b01ccb4-1002-4e21-8f96-788fd650bee1 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:34.064671 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7b01ccb4-1002-4e21-8f96-788fd650bee1 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:34.067117 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7b01ccb4-1002-4e21-8f96-788fd650bee1 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:34.309505 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-d6023b96-a7ca-414a-ab75-8dc385b3e87c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:34.322536 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-d6023b96-a7ca-414a-ab75-8dc385b3e87c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1321 microversion: 2.1 time: 0.708571 May 10 03:19:34.322536 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 35/75] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:33 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1321 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:34.334394 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-baebeea8-6604-4c98-8481-2f5638c2cf32 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:34.335408 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-baebeea8-6604-4c98-8481-2f5638c2cf32 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:34.353653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-baebeea8-6604-4c98-8481-2f5638c2cf32 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:34.355263 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-baebeea8-6604-4c98-8481-2f5638c2cf32 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:34.356910 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-baebeea8-6604-4c98-8481-2f5638c2cf32 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:34.358310 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-baebeea8-6604-4c98-8481-2f5638c2cf32 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:34.734711 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-7b01ccb4-1002-4e21-8f96-788fd650bee1 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:34.747513 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-7b01ccb4-1002-4e21-8f96-788fd650bee1 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:34.750269 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-7b01ccb4-1002-4e21-8f96-788fd650bee1 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:34.764870 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-7b01ccb4-1002-4e21-8f96-788fd650bee1 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1405 microversion: 2.20 time: 0.727058 May 10 03:19:34.765851 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 41/76] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:19:34 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1405 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:34.772419 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-0c35c935-851b-4ab6-83cc-8be256fb4b78 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:34.773160 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-0c35c935-851b-4ab6-83cc-8be256fb4b78 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:35.037151 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-0c35c935-851b-4ab6-83cc-8be256fb4b78 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:35.054382 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-0c35c935-851b-4ab6-83cc-8be256fb4b78 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1240 microversion: 2.1 time: 0.287055 May 10 03:19:35.063809 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 42/77] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:34 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1240 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:35.074419 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-78afb8d6-ebcc-4635-b1c7-54826aafc7d1 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:35.075054 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-78afb8d6-ebcc-4635-b1c7-54826aafc7d1 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:35.088503 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-78afb8d6-ebcc-4635-b1c7-54826aafc7d1 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:35.088953 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-78afb8d6-ebcc-4635-b1c7-54826aafc7d1 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:35.089736 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-78afb8d6-ebcc-4635-b1c7-54826aafc7d1 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:35.093121 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-78afb8d6-ebcc-4635-b1c7-54826aafc7d1 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:35.113421 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-baebeea8-6604-4c98-8481-2f5638c2cf32 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:35.126732 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-baebeea8-6604-4c98-8481-2f5638c2cf32 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1363 microversion: 2.1 time: 0.804927 May 10 03:19:35.127623 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 36/78] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:34 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1363 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:35.339182 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-25b23f5e-ad55-4d90-831b-581ac1d13ade tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:35.339182 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-25b23f5e-ad55-4d90-831b-581ac1d13ade tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:35.349088 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-25b23f5e-ad55-4d90-831b-581ac1d13ade tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:35.353148 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-25b23f5e-ad55-4d90-831b-581ac1d13ade tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:35.354188 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-25b23f5e-ad55-4d90-831b-581ac1d13ade tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:35.354630 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-25b23f5e-ad55-4d90-831b-581ac1d13ade tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:35.743049 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-78afb8d6-ebcc-4635-b1c7-54826aafc7d1 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:35.750519 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-78afb8d6-ebcc-4635-b1c7-54826aafc7d1 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1502 microversion: 2.1 time: 0.685394 May 10 03:19:35.751173 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 43/79] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:35 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1502 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:35.930001 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-9c804b8f-fda0-4846-9779-699c713bef27 req-5eec32dc-799d-43ea-ab5d-bb2e1b2f5dfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b289186d-a316-4521-92a0-4e13ae9b0083", "tag": "9d61ae83-c5a2-4582-8cde-df85f658226e"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:35.949318 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-9c804b8f-fda0-4846-9779-699c713bef27 req-5eec32dc-799d-43ea-ab5d-bb2e1b2f5dfe service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:35.949766 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-9c804b8f-fda0-4846-9779-699c713bef27 req-5eec32dc-799d-43ea-ab5d-bb2e1b2f5dfe service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:35.951155 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-25b23f5e-ad55-4d90-831b-581ac1d13ade tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:35.970171 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-25b23f5e-ad55-4d90-831b-581ac1d13ade tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1321 microversion: 2.1 time: 0.632789 May 10 03:19:35.970839 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-9c804b8f-fda0-4846-9779-699c713bef27 req-5eec32dc-799d-43ea-ab5d-bb2e1b2f5dfe service nova] Creating event network-changed:9d61ae83-c5a2-4582-8cde-df85f658226e for instance b289186d-a316-4521-92a0-4e13ae9b0083 on hv-cinder-83009 May 10 03:19:35.979757 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-9c804b8f-fda0-4846-9779-699c713bef27 req-5eec32dc-799d-43ea-ab5d-bb2e1b2f5dfe service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.223467 May 10 03:19:35.981253 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 44/80] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:35.988681 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 37/81] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:35 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1321 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:35.998800 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-45e56005-4a97-4e78-a83c-7bda0f3c7a03 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:36.000276 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-45e56005-4a97-4e78-a83c-7bda0f3c7a03 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:36.011014 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-45e56005-4a97-4e78-a83c-7bda0f3c7a03 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:36.011744 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-45e56005-4a97-4e78-a83c-7bda0f3c7a03 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:36.012790 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-45e56005-4a97-4e78-a83c-7bda0f3c7a03 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:36.014377 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-45e56005-4a97-4e78-a83c-7bda0f3c7a03 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:36.075856 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-2339b675-1144-4b81-8559-196663e46083 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:36.076497 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-2339b675-1144-4b81-8559-196663e46083 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:36.088882 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2339b675-1144-4b81-8559-196663e46083 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:36.089636 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2339b675-1144-4b81-8559-196663e46083 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:36.090843 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2339b675-1144-4b81-8559-196663e46083 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:36.091562 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2339b675-1144-4b81-8559-196663e46083 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:36.332895 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-2339b675-1144-4b81-8559-196663e46083 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:36.341754 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-2339b675-1144-4b81-8559-196663e46083 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1292 microversion: 2.1 time: 0.268341 May 10 03:19:36.354366 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 38/82] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:36 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1292 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:36.374544 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-e003827f-6837-4918-ae48-f648245408fb tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:36.375543 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-e003827f-6837-4918-ae48-f648245408fb tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:36.387070 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e003827f-6837-4918-ae48-f648245408fb tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:36.388506 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e003827f-6837-4918-ae48-f648245408fb tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:36.389473 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e003827f-6837-4918-ae48-f648245408fb tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:36.390220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e003827f-6837-4918-ae48-f648245408fb tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:36.399377 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-45e56005-4a97-4e78-a83c-7bda0f3c7a03 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:36.415101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-45e56005-4a97-4e78-a83c-7bda0f3c7a03 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:36.422116 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-45e56005-4a97-4e78-a83c-7bda0f3c7a03 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:36.424485 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-45e56005-4a97-4e78-a83c-7bda0f3c7a03 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1405 microversion: 2.20 time: 0.441621 May 10 03:19:36.431071 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 45/83] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:19:35 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1405 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:36.728393 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-5c50a2c0-1780-4ebd-95c4-a6e0c5c42ff8 req-b3a22fd2-5260-46b4-a4f6-71267153e10b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8796004-8adb-4534-a094-c62dfd2a9636", "tag": "373a71b7-374a-4584-ad6b-1d09a234ef37"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:36.744656 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-5c50a2c0-1780-4ebd-95c4-a6e0c5c42ff8 req-b3a22fd2-5260-46b4-a4f6-71267153e10b service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:36.745732 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-5c50a2c0-1780-4ebd-95c4-a6e0c5c42ff8 req-b3a22fd2-5260-46b4-a4f6-71267153e10b service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:36.763297 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-5c50a2c0-1780-4ebd-95c4-a6e0c5c42ff8 req-b3a22fd2-5260-46b4-a4f6-71267153e10b service nova] Creating event network-changed:373a71b7-374a-4584-ad6b-1d09a234ef37 for instance e8796004-8adb-4534-a094-c62dfd2a9636 on hv-cinder-83009 May 10 03:19:36.787566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-5c50a2c0-1780-4ebd-95c4-a6e0c5c42ff8 req-b3a22fd2-5260-46b4-a4f6-71267153e10b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051190 May 10 03:19:36.787566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 46/84] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:36.846457 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-e003827f-6837-4918-ae48-f648245408fb tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:36.858502 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-e003827f-6837-4918-ae48-f648245408fb tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1363 microversion: 2.1 time: 0.501811 May 10 03:19:36.859105 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 39/85] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:36 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1363 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:37.004902 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-2ee175f1-75a3-430a-a603-1205dd331fb0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:37.005672 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-2ee175f1-75a3-430a-a603-1205dd331fb0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:37.021027 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2ee175f1-75a3-430a-a603-1205dd331fb0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:37.021474 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2ee175f1-75a3-430a-a603-1205dd331fb0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:37.022265 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2ee175f1-75a3-430a-a603-1205dd331fb0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:37.022694 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2ee175f1-75a3-430a-a603-1205dd331fb0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:37.359326 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-51e6a5ec-1a3b-4228-8fc0-d4707a02fb59 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:37.360304 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-51e6a5ec-1a3b-4228-8fc0-d4707a02fb59 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:37.367863 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-51e6a5ec-1a3b-4228-8fc0-d4707a02fb59 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:37.368353 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-51e6a5ec-1a3b-4228-8fc0-d4707a02fb59 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:37.369250 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-51e6a5ec-1a3b-4228-8fc0-d4707a02fb59 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:37.369699 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-51e6a5ec-1a3b-4228-8fc0-d4707a02fb59 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:37.615461 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-51e6a5ec-1a3b-4228-8fc0-d4707a02fb59 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:37.625293 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-51e6a5ec-1a3b-4228-8fc0-d4707a02fb59 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1298 microversion: 2.1 time: 0.270534 May 10 03:19:37.636582 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 40/86] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:37 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1298 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:37.642268 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-cbef75ab-ccaa-4c52-b757-e83efda78d34 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:37.643105 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-cbef75ab-ccaa-4c52-b757-e83efda78d34 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:37.647921 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-2ee175f1-75a3-430a-a603-1205dd331fb0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:37.651538 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cbef75ab-ccaa-4c52-b757-e83efda78d34 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:37.652208 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cbef75ab-ccaa-4c52-b757-e83efda78d34 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:37.653162 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cbef75ab-ccaa-4c52-b757-e83efda78d34 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:37.653744 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cbef75ab-ccaa-4c52-b757-e83efda78d34 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:37.656725 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-2ee175f1-75a3-430a-a603-1205dd331fb0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1321 microversion: 2.1 time: 0.656101 May 10 03:19:37.667118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 47/87] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:36 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1321 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:37.832039 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-cbef75ab-ccaa-4c52-b757-e83efda78d34 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:37.842323 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-cbef75ab-ccaa-4c52-b757-e83efda78d34 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:37.844085 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-cbef75ab-ccaa-4c52-b757-e83efda78d34 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:37.845630 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-cbef75ab-ccaa-4c52-b757-e83efda78d34 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1405 microversion: 2.20 time: 0.207565 May 10 03:19:37.846192 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 41/88] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:19:37 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1405 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:37.876162 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-0043b17d-30e0-4869-a486-4e5e67a7ee52 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:37.876776 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-0043b17d-30e0-4869-a486-4e5e67a7ee52 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:37.883560 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0043b17d-30e0-4869-a486-4e5e67a7ee52 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:37.884273 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0043b17d-30e0-4869-a486-4e5e67a7ee52 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:37.885221 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0043b17d-30e0-4869-a486-4e5e67a7ee52 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:37.885807 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0043b17d-30e0-4869-a486-4e5e67a7ee52 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:37.983483 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-0c3d8da3-73f2-4a1f-8ac1-cc085379b00e tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c6d97f5-aa7f-45a7-8d3b-0a2532e9d594"}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:37.983483 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-0c3d8da3-73f2-4a1f-8ac1-cc085379b00e tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:37.987434 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0c3d8da3-73f2-4a1f-8ac1-cc085379b00e tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:37.987999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0c3d8da3-73f2-4a1f-8ac1-cc085379b00e tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:37.988921 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0c3d8da3-73f2-4a1f-8ac1-cc085379b00e tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:37.989458 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0c3d8da3-73f2-4a1f-8ac1-cc085379b00e tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:38.087645 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-0043b17d-30e0-4869-a486-4e5e67a7ee52 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:38.096483 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-0043b17d-30e0-4869-a486-4e5e67a7ee52 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1363 microversion: 2.1 time: 0.225081 May 10 03:19:38.097701 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 48/89] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:37 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:38.120803 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-6225095b-2d21-4512-b5be-7814e65df4c7 req-65e0c9a8-2dbf-49c0-b0b6-a680fd980934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1813031a-ba52-4826-9b73-69ae2af70c13", "tag": "0b6928e9-9a74-46cf-b5b0-028b132f61ce"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:38.134144 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-6225095b-2d21-4512-b5be-7814e65df4c7 req-65e0c9a8-2dbf-49c0-b0b6-a680fd980934 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:38.134929 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-6225095b-2d21-4512-b5be-7814e65df4c7 req-65e0c9a8-2dbf-49c0-b0b6-a680fd980934 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:38.146819 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-6225095b-2d21-4512-b5be-7814e65df4c7 req-65e0c9a8-2dbf-49c0-b0b6-a680fd980934 service nova] Creating event network-changed:0b6928e9-9a74-46cf-b5b0-028b132f61ce for instance 1813031a-ba52-4826-9b73-69ae2af70c13 on hv-cinder-83009 May 10 03:19:38.152560 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-6225095b-2d21-4512-b5be-7814e65df4c7 req-65e0c9a8-2dbf-49c0-b0b6-a680fd980934 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036587 May 10 03:19:38.153473 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 49/90] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:19:38.644509 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-9e8eaa70-3169-4854-8458-b6d4d1595bcf tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:38.645336 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-9e8eaa70-3169-4854-8458-b6d4d1595bcf tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:38.651513 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9e8eaa70-3169-4854-8458-b6d4d1595bcf tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:38.652085 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9e8eaa70-3169-4854-8458-b6d4d1595bcf tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:38.652742 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9e8eaa70-3169-4854-8458-b6d4d1595bcf tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:38.653172 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9e8eaa70-3169-4854-8458-b6d4d1595bcf tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:38.796250 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-9e8eaa70-3169-4854-8458-b6d4d1595bcf tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:38.803870 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-9e8eaa70-3169-4854-8458-b6d4d1595bcf tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1365 microversion: 2.1 time: 0.163731 May 10 03:19:38.804591 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 50/91] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:38 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:38.808854 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-559037f6-be70-4d0d-94ba-464e4ca0d64d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:38.809514 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-559037f6-be70-4d0d-94ba-464e4ca0d64d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:38.815650 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-559037f6-be70-4d0d-94ba-464e4ca0d64d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:38.816076 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-559037f6-be70-4d0d-94ba-464e4ca0d64d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:38.816845 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-559037f6-be70-4d0d-94ba-464e4ca0d64d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:38.817276 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-559037f6-be70-4d0d-94ba-464e4ca0d64d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:38.972228 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-559037f6-be70-4d0d-94ba-464e4ca0d64d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:38.980469 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-559037f6-be70-4d0d-94ba-464e4ca0d64d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1321 microversion: 2.1 time: 0.174604 May 10 03:19:38.981291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 51/92] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:38 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:38.985981 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-5e5f6d07-c690-4605-b21d-a6696e44c672 req-e5fa2801-49bc-4c76-a9b4-4e55710c5bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "544c3a1e-c28b-47ab-bf79-33a141cf9beb", "tag": "f0cb85c5-3fec-4e59-9a36-21921ca34926"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:38.993945 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-5e5f6d07-c690-4605-b21d-a6696e44c672 req-e5fa2801-49bc-4c76-a9b4-4e55710c5bc6 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:38.994394 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-5e5f6d07-c690-4605-b21d-a6696e44c672 req-e5fa2801-49bc-4c76-a9b4-4e55710c5bc6 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:39.006153 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-5e5f6d07-c690-4605-b21d-a6696e44c672 req-e5fa2801-49bc-4c76-a9b4-4e55710c5bc6 service nova] Creating event network-changed:f0cb85c5-3fec-4e59-9a36-21921ca34926 for instance 544c3a1e-c28b-47ab-bf79-33a141cf9beb on hv-cinder-83009 May 10 03:19:39.016191 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-0c3d8da3-73f2-4a1f-8ac1-cc085379b00e tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "POST /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.035473 May 10 03:19:39.016191 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 42/93] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 03:19:37 2022] POST /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea/os-volume_attachments => generated 194 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:39.016731 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-5e5f6d07-c690-4605-b21d-a6696e44c672 req-e5fa2801-49bc-4c76-a9b4-4e55710c5bc6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028837 May 10 03:19:39.016731 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 52/94] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:39.017038 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-bd105880-5023-413a-a17a-0c7f3b746db6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:39.018096 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-bd105880-5023-413a-a17a-0c7f3b746db6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:39.025917 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bd105880-5023-413a-a17a-0c7f3b746db6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:39.026424 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bd105880-5023-413a-a17a-0c7f3b746db6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:39.027113 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bd105880-5023-413a-a17a-0c7f3b746db6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:39.027788 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bd105880-5023-413a-a17a-0c7f3b746db6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:39.115861 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-4ecf0705-5745-4b49-b8e8-a9b86fc2937d tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:39.116655 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-4ecf0705-5745-4b49-b8e8-a9b86fc2937d tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:39.123394 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4ecf0705-5745-4b49-b8e8-a9b86fc2937d tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:39.123841 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4ecf0705-5745-4b49-b8e8-a9b86fc2937d tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:39.125520 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4ecf0705-5745-4b49-b8e8-a9b86fc2937d tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:39.131146 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4ecf0705-5745-4b49-b8e8-a9b86fc2937d tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:39.205038 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-bd105880-5023-413a-a17a-0c7f3b746db6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:39.225922 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-bd105880-5023-413a-a17a-0c7f3b746db6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:39.229949 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-bd105880-5023-413a-a17a-0c7f3b746db6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:39.231989 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-bd105880-5023-413a-a17a-0c7f3b746db6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1405 microversion: 2.20 time: 0.221111 May 10 03:19:39.232788 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 43/95] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:19:39 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1405 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:39.554331 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-4ecf0705-5745-4b49-b8e8-a9b86fc2937d tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:39.567033 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-4ecf0705-5745-4b49-b8e8-a9b86fc2937d tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1363 microversion: 2.1 time: 0.455292 May 10 03:19:39.573060 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 53/96] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:39 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1363 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:39.824174 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-ce8fd939-610c-4766-bb45-808b2f5ec62a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:39.825039 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-ce8fd939-610c-4766-bb45-808b2f5ec62a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:39.832931 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ce8fd939-610c-4766-bb45-808b2f5ec62a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:39.833615 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ce8fd939-610c-4766-bb45-808b2f5ec62a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:39.834575 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ce8fd939-610c-4766-bb45-808b2f5ec62a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:39.835152 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ce8fd939-610c-4766-bb45-808b2f5ec62a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:40.000654 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-8cc3bcd0-d3c6-4287-bde9-b416d311f905 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:40.001201 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8cc3bcd0-d3c6-4287-bde9-b416d311f905 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:40.015510 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8cc3bcd0-d3c6-4287-bde9-b416d311f905 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:40.017133 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8cc3bcd0-d3c6-4287-bde9-b416d311f905 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:40.018329 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8cc3bcd0-d3c6-4287-bde9-b416d311f905 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:40.021871 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8cc3bcd0-d3c6-4287-bde9-b416d311f905 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:40.219536 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ce8fd939-610c-4766-bb45-808b2f5ec62a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:40.228379 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-ce8fd939-610c-4766-bb45-808b2f5ec62a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1365 microversion: 2.1 time: 0.408832 May 10 03:19:40.238366 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 44/97] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:39 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1365 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:40.266759 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-d06ec020-741f-414c-b1f5-fb0aa7c3bd83 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:40.270125 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-d06ec020-741f-414c-b1f5-fb0aa7c3bd83 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:40.285708 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d06ec020-741f-414c-b1f5-fb0aa7c3bd83 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:40.288110 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d06ec020-741f-414c-b1f5-fb0aa7c3bd83 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:40.290539 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d06ec020-741f-414c-b1f5-fb0aa7c3bd83 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:40.292459 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d06ec020-741f-414c-b1f5-fb0aa7c3bd83 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:40.565967 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8cc3bcd0-d3c6-4287-bde9-b416d311f905 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:40.581103 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-8cc3bcd0-d3c6-4287-bde9-b416d311f905 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1321 microversion: 2.1 time: 0.584203 May 10 03:19:40.581957 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 54/98] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:39 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1321 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:40.591591 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c70c4deb-c877-4b2b-9b39-cdcd3631b19e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:40.592619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-c70c4deb-c877-4b2b-9b39-cdcd3631b19e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:40.600303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c70c4deb-c877-4b2b-9b39-cdcd3631b19e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:40.601090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c70c4deb-c877-4b2b-9b39-cdcd3631b19e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:40.602632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c70c4deb-c877-4b2b-9b39-cdcd3631b19e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:40.603292 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c70c4deb-c877-4b2b-9b39-cdcd3631b19e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:40.781963 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-d06ec020-741f-414c-b1f5-fb0aa7c3bd83 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:40.794528 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-d06ec020-741f-414c-b1f5-fb0aa7c3bd83 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:40.797119 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-d06ec020-741f-414c-b1f5-fb0aa7c3bd83 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:40.801184 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-d06ec020-741f-414c-b1f5-fb0aa7c3bd83 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1405 microversion: 2.20 time: 0.540743 May 10 03:19:40.801769 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 45/99] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:19:40 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1405 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:40.869042 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-c70c4deb-c877-4b2b-9b39-cdcd3631b19e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:40.879248 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-c70c4deb-c877-4b2b-9b39-cdcd3631b19e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1363 microversion: 2.1 time: 0.294223 May 10 03:19:40.880403 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 55/100] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:40 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1363 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:41.247163 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-5efdb4c4-268b-4422-b229-5ac3d015b136 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:41.248498 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-5efdb4c4-268b-4422-b229-5ac3d015b136 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:41.256739 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5efdb4c4-268b-4422-b229-5ac3d015b136 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:41.257419 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5efdb4c4-268b-4422-b229-5ac3d015b136 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:41.259281 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5efdb4c4-268b-4422-b229-5ac3d015b136 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:41.259919 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5efdb4c4-268b-4422-b229-5ac3d015b136 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:41.329261 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-38a58510-b476-48e9-a9a2-ac8f08cef311 req-42f02ee3-3c3c-4e8f-b9d2-c8be6baaee78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a275173c-51a6-4cc6-aef2-b30bcee8b67b", "tag": "3675090a-d6b4-4972-9846-20ea88eb78e8"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:41.347515 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-38a58510-b476-48e9-a9a2-ac8f08cef311 req-42f02ee3-3c3c-4e8f-b9d2-c8be6baaee78 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:41.348564 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-38a58510-b476-48e9-a9a2-ac8f08cef311 req-42f02ee3-3c3c-4e8f-b9d2-c8be6baaee78 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:41.370688 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-38a58510-b476-48e9-a9a2-ac8f08cef311 req-42f02ee3-3c3c-4e8f-b9d2-c8be6baaee78 service nova] Creating event network-changed:3675090a-d6b4-4972-9846-20ea88eb78e8 for instance a275173c-51a6-4cc6-aef2-b30bcee8b67b on hv-cinder-83009 May 10 03:19:41.376659 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-38a58510-b476-48e9-a9a2-ac8f08cef311 req-42f02ee3-3c3c-4e8f-b9d2-c8be6baaee78 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052310 May 10 03:19:41.384170 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 56/101] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:19:41.447789 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5efdb4c4-268b-4422-b229-5ac3d015b136 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:41.458127 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-5efdb4c4-268b-4422-b229-5ac3d015b136 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1365 microversion: 2.1 time: 0.212909 May 10 03:19:41.459890 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 46/102] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:41 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:41.602015 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-18a1e598-9ce8-4e44-81a4-aa76d5f8e158 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:41.602785 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-18a1e598-9ce8-4e44-81a4-aa76d5f8e158 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:41.609469 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-18a1e598-9ce8-4e44-81a4-aa76d5f8e158 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:41.609928 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-18a1e598-9ce8-4e44-81a4-aa76d5f8e158 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:41.610708 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-18a1e598-9ce8-4e44-81a4-aa76d5f8e158 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:41.611148 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-18a1e598-9ce8-4e44-81a4-aa76d5f8e158 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:41.748646 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-18a1e598-9ce8-4e44-81a4-aa76d5f8e158 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:41.755896 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-18a1e598-9ce8-4e44-81a4-aa76d5f8e158 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1321 microversion: 2.1 time: 0.158233 May 10 03:19:41.756673 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 57/103] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:41 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:41.818673 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-6298fc0b-a928-4578-a4de-bd5cbf83554a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:41.819397 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-6298fc0b-a928-4578-a4de-bd5cbf83554a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:41.834004 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6298fc0b-a928-4578-a4de-bd5cbf83554a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:41.834613 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6298fc0b-a928-4578-a4de-bd5cbf83554a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:41.835254 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6298fc0b-a928-4578-a4de-bd5cbf83554a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:41.835702 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6298fc0b-a928-4578-a4de-bd5cbf83554a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:41.897065 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-2147a3e3-87a4-47df-8091-3ec24106e8d3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:41.897692 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-2147a3e3-87a4-47df-8091-3ec24106e8d3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:41.906786 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2147a3e3-87a4-47df-8091-3ec24106e8d3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:41.907242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2147a3e3-87a4-47df-8091-3ec24106e8d3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:41.908131 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2147a3e3-87a4-47df-8091-3ec24106e8d3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:41.908581 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2147a3e3-87a4-47df-8091-3ec24106e8d3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:42.009920 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-6298fc0b-a928-4578-a4de-bd5cbf83554a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:42.019519 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-6298fc0b-a928-4578-a4de-bd5cbf83554a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:42.021046 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-6298fc0b-a928-4578-a4de-bd5cbf83554a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:42.022162 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-6298fc0b-a928-4578-a4de-bd5cbf83554a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1405 microversion: 2.20 time: 0.207469 May 10 03:19:42.022743 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 47/104] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:19:41 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1405 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:42.080440 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-2147a3e3-87a4-47df-8091-3ec24106e8d3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:42.088060 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-2147a3e3-87a4-47df-8091-3ec24106e8d3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1363 microversion: 2.1 time: 0.194750 May 10 03:19:42.088770 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 58/105] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:41 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:42.475727 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-c2aa832c-526d-4fda-bbb3-2de2239961d4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:42.476526 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-c2aa832c-526d-4fda-bbb3-2de2239961d4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:42.484960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c2aa832c-526d-4fda-bbb3-2de2239961d4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:42.485411 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c2aa832c-526d-4fda-bbb3-2de2239961d4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:42.486181 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c2aa832c-526d-4fda-bbb3-2de2239961d4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:42.486614 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c2aa832c-526d-4fda-bbb3-2de2239961d4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:42.623139 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-c2aa832c-526d-4fda-bbb3-2de2239961d4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:42.633558 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-c2aa832c-526d-4fda-bbb3-2de2239961d4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1365 microversion: 2.1 time: 0.161426 May 10 03:19:42.634016 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 48/106] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:42 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:42.665245 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-335e0864-4ec1-49f1-93c9-d582f1c50912 req-61e98932-f1c1-4fa4-901c-c9cab346e51a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b289186d-a316-4521-92a0-4e13ae9b0083", "name": "network-vif-plugged", "status": "completed", "tag": "9d61ae83-c5a2-4582-8cde-df85f658226e"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:42.673677 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-335e0864-4ec1-49f1-93c9-d582f1c50912 req-61e98932-f1c1-4fa4-901c-c9cab346e51a service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:42.674331 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-335e0864-4ec1-49f1-93c9-d582f1c50912 req-61e98932-f1c1-4fa4-901c-c9cab346e51a service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:42.687613 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-335e0864-4ec1-49f1-93c9-d582f1c50912 req-61e98932-f1c1-4fa4-901c-c9cab346e51a service nova] Creating event network-vif-plugged:9d61ae83-c5a2-4582-8cde-df85f658226e for instance b289186d-a316-4521-92a0-4e13ae9b0083 on hv-cinder-83009 May 10 03:19:42.692810 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-335e0864-4ec1-49f1-93c9-d582f1c50912 req-61e98932-f1c1-4fa4-901c-c9cab346e51a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031975 May 10 03:19:42.693776 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 59/107] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:19:42.776776 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-25572e63-2b23-41ee-b462-9b0218c951e3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:42.777419 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-25572e63-2b23-41ee-b462-9b0218c951e3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:42.783932 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-25572e63-2b23-41ee-b462-9b0218c951e3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:42.784432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-25572e63-2b23-41ee-b462-9b0218c951e3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:42.785428 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-25572e63-2b23-41ee-b462-9b0218c951e3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:42.785983 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-25572e63-2b23-41ee-b462-9b0218c951e3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:43.030686 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-25572e63-2b23-41ee-b462-9b0218c951e3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:43.040259 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-25572e63-2b23-41ee-b462-9b0218c951e3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1321 microversion: 2.1 time: 0.267406 May 10 03:19:43.043158 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-1368ff18-50bc-4e37-b4f3-fb77d63563ff tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:43.043937 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-1368ff18-50bc-4e37-b4f3-fb77d63563ff tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:43.045183 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 49/108] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:42 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1321 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:43.068311 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1368ff18-50bc-4e37-b4f3-fb77d63563ff tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:43.069034 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1368ff18-50bc-4e37-b4f3-fb77d63563ff tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:43.069756 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1368ff18-50bc-4e37-b4f3-fb77d63563ff tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:43.070781 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1368ff18-50bc-4e37-b4f3-fb77d63563ff tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:43.104307 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-106ffbb7-5bf8-4ea2-8b3f-93b1bb6b2185 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:43.105102 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-106ffbb7-5bf8-4ea2-8b3f-93b1bb6b2185 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:43.114047 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-106ffbb7-5bf8-4ea2-8b3f-93b1bb6b2185 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:43.115601 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-106ffbb7-5bf8-4ea2-8b3f-93b1bb6b2185 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:43.118065 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-106ffbb7-5bf8-4ea2-8b3f-93b1bb6b2185 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:43.118522 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-106ffbb7-5bf8-4ea2-8b3f-93b1bb6b2185 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:43.329319 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-1368ff18-50bc-4e37-b4f3-fb77d63563ff tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:43.340636 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-106ffbb7-5bf8-4ea2-8b3f-93b1bb6b2185 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:43.342370 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-1368ff18-50bc-4e37-b4f3-fb77d63563ff tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:43.349792 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-106ffbb7-5bf8-4ea2-8b3f-93b1bb6b2185 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1363 microversion: 2.1 time: 0.249633 May 10 03:19:43.350439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 50/109] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:43 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:43.356111 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-1368ff18-50bc-4e37-b4f3-fb77d63563ff tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:43.357616 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-1368ff18-50bc-4e37-b4f3-fb77d63563ff tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1405 microversion: 2.20 time: 0.320566 May 10 03:19:43.359338 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 60/110] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:19:43 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1405 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:19:43.563236 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-fe049fd3-08ca-4ed8-8763-643b643521f9 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:43.563236 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-fe049fd3-08ca-4ed8-8763-643b643521f9 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:43.565910 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fe049fd3-08ca-4ed8-8763-643b643521f9 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:43.566360 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fe049fd3-08ca-4ed8-8763-643b643521f9 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:43.567131 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fe049fd3-08ca-4ed8-8763-643b643521f9 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:43.567695 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fe049fd3-08ca-4ed8-8763-643b643521f9 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:43.597972 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-fe049fd3-08ca-4ed8-8763-643b643521f9 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Going to try to terminate instance {{(pid=117400) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:19:43.651554 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-5704bdcb-2113-47ab-b6b1-530a41d0ce0a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:43.652277 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-5704bdcb-2113-47ab-b6b1-530a41d0ce0a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:43.658799 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5704bdcb-2113-47ab-b6b1-530a41d0ce0a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:43.659247 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5704bdcb-2113-47ab-b6b1-530a41d0ce0a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:43.660051 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5704bdcb-2113-47ab-b6b1-530a41d0ce0a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:43.660499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5704bdcb-2113-47ab-b6b1-530a41d0ce0a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:43.851452 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-5704bdcb-2113-47ab-b6b1-530a41d0ce0a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:43.859664 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-5704bdcb-2113-47ab-b6b1-530a41d0ce0a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1365 microversion: 2.1 time: 0.212681 May 10 03:19:43.860427 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 61/111] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:43 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:43.911777 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-787d9a0e-2ec0-4464-ab5c-203bb0171385 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-185035429", "imageRef": "7ce6e103-a571-4b59-9162-ff1107650c97", "flavorRef": "452"}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:43.957180 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-fe049fd3-08ca-4ed8-8763-643b643521f9 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 204 len: 0 microversion: 2.1 time: 0.402573 May 10 03:19:43.957929 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 51/112] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:19:43 2022] DELETE /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:19:43.967570 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.network.neutron [None req-787d9a0e-2ec0-4464-ab5c-203bb0171385 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] validate_networks() for None {{(pid=117399) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:19:43.971192 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-8b07711e-9069-4d0f-a0a4-0c76b5c67a39 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:43.972127 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-8b07711e-9069-4d0f-a0a4-0c76b5c67a39 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:43.978858 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8b07711e-9069-4d0f-a0a4-0c76b5c67a39 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:43.979338 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8b07711e-9069-4d0f-a0a4-0c76b5c67a39 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:43.980144 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8b07711e-9069-4d0f-a0a4-0c76b5c67a39 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:43.980856 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8b07711e-9069-4d0f-a0a4-0c76b5c67a39 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:44.295363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-8b07711e-9069-4d0f-a0a4-0c76b5c67a39 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:44.307072 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-8b07711e-9069-4d0f-a0a4-0c76b5c67a39 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1554 microversion: 2.1 time: 0.339819 May 10 03:19:44.308661 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 52/113] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:43 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1554 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:44.315964 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-2b4c42bd-bd7c-4ed6-811f-9b6b6df2918b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:44.317597 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-2b4c42bd-bd7c-4ed6-811f-9b6b6df2918b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:44.329225 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2b4c42bd-bd7c-4ed6-811f-9b6b6df2918b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:44.329922 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2b4c42bd-bd7c-4ed6-811f-9b6b6df2918b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:44.330925 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2b4c42bd-bd7c-4ed6-811f-9b6b6df2918b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:44.331578 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2b4c42bd-bd7c-4ed6-811f-9b6b6df2918b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:44.353986 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-787d9a0e-2ec0-4464-ab5c-203bb0171385 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Flavor limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:19:44.354733 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-787d9a0e-2ec0-4464-ab5c-203bb0171385 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Image limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:19:44.355401 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-787d9a0e-2ec0-4464-ab5c-203bb0171385 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Flavor pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:19:44.355825 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-787d9a0e-2ec0-4464-ab5c-203bb0171385 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Image pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:19:44.356772 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-787d9a0e-2ec0-4464-ab5c-203bb0171385 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:19:44.368198 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-787d9a0e-2ec0-4464-ab5c-203bb0171385 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:44.368874 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-787d9a0e-2ec0-4464-ab5c-203bb0171385 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:44.370077 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-787d9a0e-2ec0-4464-ab5c-203bb0171385 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:44.370653 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-787d9a0e-2ec0-4464-ab5c-203bb0171385 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:44.389719 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-787d9a0e-2ec0-4464-ab5c-203bb0171385 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Getting quotas for project 895dbe17859e43a18bb013a98f83a45e. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:19:44.393927 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-787d9a0e-2ec0-4464-ab5c-203bb0171385 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Getting quotas for user 7b91d4485efb4a689a892233333959ba and project 895dbe17859e43a18bb013a98f83a45e. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:19:44.405650 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-787d9a0e-2ec0-4464-ab5c-203bb0171385 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Going to run 1 instances... {{(pid=117399) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:19:44.408466 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-787d9a0e-2ec0-4464-ab5c-203bb0171385 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ce6e103-a571-4b59-9162-ff1107650c97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:19:44.498313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-2b4c42bd-bd7c-4ed6-811f-9b6b6df2918b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:44.506802 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-2b4c42bd-bd7c-4ed6-811f-9b6b6df2918b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1321 microversion: 2.1 time: 0.196957 May 10 03:19:44.507888 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 53/114] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:44 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:44.513065 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-e1bc9be1-4e40-41d2-a150-c8cc0ffe56df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:44.517851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-e1bc9be1-4e40-41d2-a150-c8cc0ffe56df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:44.522143 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e1bc9be1-4e40-41d2-a150-c8cc0ffe56df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:44.522900 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e1bc9be1-4e40-41d2-a150-c8cc0ffe56df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:44.524294 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e1bc9be1-4e40-41d2-a150-c8cc0ffe56df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:44.524931 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e1bc9be1-4e40-41d2-a150-c8cc0ffe56df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:44.638350 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-787d9a0e-2ec0-4464-ab5c-203bb0171385 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.730418 May 10 03:19:44.642496 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 62/115] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 03:19:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:19:44.651619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-6897a2ff-fad1-4df1-ae46-d9136ee7ec71 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:44.652993 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-6897a2ff-fad1-4df1-ae46-d9136ee7ec71 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:44.665482 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-e1bc9be1-4e40-41d2-a150-c8cc0ffe56df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:44.667929 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6897a2ff-fad1-4df1-ae46-d9136ee7ec71 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:44.668513 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6897a2ff-fad1-4df1-ae46-d9136ee7ec71 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:44.669385 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6897a2ff-fad1-4df1-ae46-d9136ee7ec71 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:44.670050 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6897a2ff-fad1-4df1-ae46-d9136ee7ec71 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:44.677366 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-e1bc9be1-4e40-41d2-a150-c8cc0ffe56df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1363 microversion: 2.1 time: 0.168236 May 10 03:19:44.681535 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 54/116] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:44 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:44.689247 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-5776673a-254e-48b3-b794-1fe2c284aff0 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:44.690003 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-5776673a-254e-48b3-b794-1fe2c284aff0 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:44.786227 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5776673a-254e-48b3-b794-1fe2c284aff0 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b91d4485efb4a689a892233333959ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895dbe17859e43a18bb013a98f83a45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:44.795373 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-5776673a-254e-48b3-b794-1fe2c284aff0 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064" status: 200 len: 1214 microversion: 2.1 time: 0.112631 May 10 03:19:44.798264 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 55/117] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:44 2022] GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:44.827239 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-70f03ce7-b73a-44f8-b20d-391b71d920fc req-09d23999-4116-4564-8eed-8521ea850cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1813031a-ba52-4826-9b73-69ae2af70c13", "name": "network-vif-plugged", "status": "completed", "tag": "0b6928e9-9a74-46cf-b5b0-028b132f61ce"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:44.843074 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-70f03ce7-b73a-44f8-b20d-391b71d920fc req-09d23999-4116-4564-8eed-8521ea850cb3 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:44.843513 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-70f03ce7-b73a-44f8-b20d-391b71d920fc req-09d23999-4116-4564-8eed-8521ea850cb3 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:44.855759 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-70f03ce7-b73a-44f8-b20d-391b71d920fc req-09d23999-4116-4564-8eed-8521ea850cb3 service nova] Creating event network-vif-plugged:0b6928e9-9a74-46cf-b5b0-028b132f61ce for instance 1813031a-ba52-4826-9b73-69ae2af70c13 on hv-cinder-83009 May 10 03:19:44.859941 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-6897a2ff-fad1-4df1-ae46-d9136ee7ec71 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:44.860480 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-70f03ce7-b73a-44f8-b20d-391b71d920fc req-09d23999-4116-4564-8eed-8521ea850cb3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038174 May 10 03:19:44.861003 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 56/118] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:19:44.868119 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-6897a2ff-fad1-4df1-ae46-d9136ee7ec71 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:44.870137 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-6897a2ff-fad1-4df1-ae46-d9136ee7ec71 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:44.871246 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-6897a2ff-fad1-4df1-ae46-d9136ee7ec71 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1405 microversion: 2.20 time: 0.227034 May 10 03:19:44.872071 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 63/119] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:19:44 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1405 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:44.876771 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-df1f0a7f-9d17-4985-af34-560894fd1c93 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:44.877494 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-df1f0a7f-9d17-4985-af34-560894fd1c93 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:44.884370 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-df1f0a7f-9d17-4985-af34-560894fd1c93 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:44.884826 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-df1f0a7f-9d17-4985-af34-560894fd1c93 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:44.885723 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-df1f0a7f-9d17-4985-af34-560894fd1c93 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:44.886163 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-df1f0a7f-9d17-4985-af34-560894fd1c93 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:45.049798 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-df1f0a7f-9d17-4985-af34-560894fd1c93 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:45.057493 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-df1f0a7f-9d17-4985-af34-560894fd1c93 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1365 microversion: 2.1 time: 0.184784 May 10 03:19:45.058067 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 57/120] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:44 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:45.325635 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-2ca5b67d-ec78-4650-ac3f-9f77374c7b8b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:45.326480 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-2ca5b67d-ec78-4650-ac3f-9f77374c7b8b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:45.332470 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2ca5b67d-ec78-4650-ac3f-9f77374c7b8b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:45.333154 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2ca5b67d-ec78-4650-ac3f-9f77374c7b8b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:45.333902 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2ca5b67d-ec78-4650-ac3f-9f77374c7b8b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:45.334333 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2ca5b67d-ec78-4650-ac3f-9f77374c7b8b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:45.525076 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-cae62a8d-ecb1-45e0-8f0e-0a09f9ba6906 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:45.525993 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-cae62a8d-ecb1-45e0-8f0e-0a09f9ba6906 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:45.537424 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cae62a8d-ecb1-45e0-8f0e-0a09f9ba6906 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:45.537807 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-2ca5b67d-ec78-4650-ac3f-9f77374c7b8b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:45.538535 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cae62a8d-ecb1-45e0-8f0e-0a09f9ba6906 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:45.540715 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cae62a8d-ecb1-45e0-8f0e-0a09f9ba6906 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:45.541333 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cae62a8d-ecb1-45e0-8f0e-0a09f9ba6906 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:45.550913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-2ca5b67d-ec78-4650-ac3f-9f77374c7b8b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1554 microversion: 2.1 time: 0.229052 May 10 03:19:45.551515 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 64/121] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:45 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1554 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:45.698791 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-7e211631-8240-4be4-9d70-6aac17bc3835 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:45.699407 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-7e211631-8240-4be4-9d70-6aac17bc3835 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:45.705682 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7e211631-8240-4be4-9d70-6aac17bc3835 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:45.706115 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7e211631-8240-4be4-9d70-6aac17bc3835 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:45.706889 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7e211631-8240-4be4-9d70-6aac17bc3835 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:45.707327 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7e211631-8240-4be4-9d70-6aac17bc3835 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:45.713059 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-cae62a8d-ecb1-45e0-8f0e-0a09f9ba6906 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:45.720423 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-cae62a8d-ecb1-45e0-8f0e-0a09f9ba6906 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1321 microversion: 2.1 time: 0.200089 May 10 03:19:45.720994 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 58/122] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:45 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:45.816758 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-b08dfed5-d262-4e4e-b41b-f97b93ef4fa0 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:45.817286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-b08dfed5-d262-4e4e-b41b-f97b93ef4fa0 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:45.830699 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b08dfed5-d262-4e4e-b41b-f97b93ef4fa0 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:45.831152 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b08dfed5-d262-4e4e-b41b-f97b93ef4fa0 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:45.831947 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b08dfed5-d262-4e4e-b41b-f97b93ef4fa0 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:45.832411 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b08dfed5-d262-4e4e-b41b-f97b93ef4fa0 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:45.899404 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-7e211631-8240-4be4-9d70-6aac17bc3835 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:45.909640 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-7e211631-8240-4be4-9d70-6aac17bc3835 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1363 microversion: 2.1 time: 0.215523 May 10 03:19:45.911033 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 65/123] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:45 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:45.912928 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-b08dfed5-d262-4e4e-b41b-f97b93ef4fa0 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b91d4485efb4a689a892233333959ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895dbe17859e43a18bb013a98f83a45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:45.916452 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-8e0c6283-2784-4e8b-945f-f9a646ab8b4a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:45.917342 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8e0c6283-2784-4e8b-945f-f9a646ab8b4a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:45.923858 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8e0c6283-2784-4e8b-945f-f9a646ab8b4a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:45.924655 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8e0c6283-2784-4e8b-945f-f9a646ab8b4a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:45.925698 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8e0c6283-2784-4e8b-945f-f9a646ab8b4a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:45.926339 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8e0c6283-2784-4e8b-945f-f9a646ab8b4a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:45.926943 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-b08dfed5-d262-4e4e-b41b-f97b93ef4fa0 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064" status: 200 len: 1218 microversion: 2.1 time: 0.116007 May 10 03:19:45.927550 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 59/124] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:45 2022] GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:46.072651 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8e0c6283-2784-4e8b-945f-f9a646ab8b4a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:46.074474 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-93322588-fb59-4a00-9181-30c9d1be52e9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:46.075298 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-93322588-fb59-4a00-9181-30c9d1be52e9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:46.083044 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8e0c6283-2784-4e8b-945f-f9a646ab8b4a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:46.086666 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-93322588-fb59-4a00-9181-30c9d1be52e9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:46.086666 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-93322588-fb59-4a00-9181-30c9d1be52e9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:46.086895 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8e0c6283-2784-4e8b-945f-f9a646ab8b4a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:46.086992 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-93322588-fb59-4a00-9181-30c9d1be52e9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:46.086992 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-93322588-fb59-4a00-9181-30c9d1be52e9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:46.087169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-8e0c6283-2784-4e8b-945f-f9a646ab8b4a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1405 microversion: 2.20 time: 0.174278 May 10 03:19:46.087985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 66/125] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:19:45 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:46.241210 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-93322588-fb59-4a00-9181-30c9d1be52e9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:46.253470 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-93322588-fb59-4a00-9181-30c9d1be52e9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1365 microversion: 2.1 time: 0.182665 May 10 03:19:46.254063 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 60/126] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:46 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:46.567998 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-8aa460a7-702e-40fe-bfb9-361ac9cfb949 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:46.568637 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8aa460a7-702e-40fe-bfb9-361ac9cfb949 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:46.578496 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8aa460a7-702e-40fe-bfb9-361ac9cfb949 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:46.579083 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8aa460a7-702e-40fe-bfb9-361ac9cfb949 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:46.579868 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8aa460a7-702e-40fe-bfb9-361ac9cfb949 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:46.580336 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8aa460a7-702e-40fe-bfb9-361ac9cfb949 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:46.737939 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-fd0b3850-bbd2-4bbc-ade7-bbd1e0d34097 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:46.744037 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-fd0b3850-bbd2-4bbc-ade7-bbd1e0d34097 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:46.765510 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fd0b3850-bbd2-4bbc-ade7-bbd1e0d34097 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:46.766198 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fd0b3850-bbd2-4bbc-ade7-bbd1e0d34097 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:46.767148 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fd0b3850-bbd2-4bbc-ade7-bbd1e0d34097 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:46.767740 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fd0b3850-bbd2-4bbc-ade7-bbd1e0d34097 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:46.779097 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8aa460a7-702e-40fe-bfb9-361ac9cfb949 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:46.791063 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-8aa460a7-702e-40fe-bfb9-361ac9cfb949 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1554 microversion: 2.1 time: 0.226962 May 10 03:19:46.801727 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 67/127] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:46 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1554 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:46.927457 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-47519d47-adce-4869-8b11-4e649dfb8df9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:46.928205 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-47519d47-adce-4869-8b11-4e649dfb8df9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:46.941355 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-47519d47-adce-4869-8b11-4e649dfb8df9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:46.941812 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-47519d47-adce-4869-8b11-4e649dfb8df9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:46.943971 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-47519d47-adce-4869-8b11-4e649dfb8df9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:46.943971 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-47519d47-adce-4869-8b11-4e649dfb8df9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:46.957078 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-fd0b3850-bbd2-4bbc-ade7-bbd1e0d34097 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:46.970056 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-fd0b3850-bbd2-4bbc-ade7-bbd1e0d34097 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1321 microversion: 2.1 time: 0.236133 May 10 03:19:46.972271 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 61/128] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:46 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:46.986465 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-01ebe8a1-4f94-470f-b7f6-a12e7008a007 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:46.988920 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-01ebe8a1-4f94-470f-b7f6-a12e7008a007 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:47.004675 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-01ebe8a1-4f94-470f-b7f6-a12e7008a007 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:47.006208 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-01ebe8a1-4f94-470f-b7f6-a12e7008a007 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:47.007237 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-01ebe8a1-4f94-470f-b7f6-a12e7008a007 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:47.011048 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-01ebe8a1-4f94-470f-b7f6-a12e7008a007 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:47.111507 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-01ebe8a1-4f94-470f-b7f6-a12e7008a007 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b91d4485efb4a689a892233333959ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895dbe17859e43a18bb013a98f83a45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:47.119296 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-01ebe8a1-4f94-470f-b7f6-a12e7008a007 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064" status: 200 len: 1210 microversion: 2.1 time: 0.145211 May 10 03:19:47.119879 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 62/129] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:46 2022] GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 => generated 1210 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:47.132977 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-2e5a4f75-a8aa-41a2-be2a-f31debe6c940 req-528832f0-02bb-4a82-83db-5dfcbb74f250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8796004-8adb-4534-a094-c62dfd2a9636", "name": "network-vif-plugged", "status": "completed", "tag": "373a71b7-374a-4584-ad6b-1d09a234ef37"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:47.146573 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-2e5a4f75-a8aa-41a2-be2a-f31debe6c940 req-528832f0-02bb-4a82-83db-5dfcbb74f250 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:47.148117 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-47519d47-adce-4869-8b11-4e649dfb8df9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:47.150109 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-2e5a4f75-a8aa-41a2-be2a-f31debe6c940 req-528832f0-02bb-4a82-83db-5dfcbb74f250 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:47.157057 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-47519d47-adce-4869-8b11-4e649dfb8df9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1363 microversion: 2.1 time: 0.234046 May 10 03:19:47.158182 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 68/130] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:46 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:47.180698 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-2e5a4f75-a8aa-41a2-be2a-f31debe6c940 req-528832f0-02bb-4a82-83db-5dfcbb74f250 service nova] Creating event network-vif-plugged:373a71b7-374a-4584-ad6b-1d09a234ef37 for instance e8796004-8adb-4534-a094-c62dfd2a9636 on hv-cinder-83009 May 10 03:19:47.193724 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-2f603ef2-3355-471a-8e07-4d8822af92e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:47.194732 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-2f603ef2-3355-471a-8e07-4d8822af92e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:47.207408 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2f603ef2-3355-471a-8e07-4d8822af92e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:47.208129 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2f603ef2-3355-471a-8e07-4d8822af92e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:47.209213 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2f603ef2-3355-471a-8e07-4d8822af92e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:47.209948 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2f603ef2-3355-471a-8e07-4d8822af92e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:47.222505 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-2e5a4f75-a8aa-41a2-be2a-f31debe6c940 req-528832f0-02bb-4a82-83db-5dfcbb74f250 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097044 May 10 03:19:47.226692 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 63/131] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:47.275344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-de38bfa8-8484-4230-ab7f-42f24b746261 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:47.276433 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-de38bfa8-8484-4230-ab7f-42f24b746261 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:47.286901 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-de38bfa8-8484-4230-ab7f-42f24b746261 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:47.291344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-de38bfa8-8484-4230-ab7f-42f24b746261 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:47.292476 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-de38bfa8-8484-4230-ab7f-42f24b746261 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:47.293192 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-de38bfa8-8484-4230-ab7f-42f24b746261 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:47.505131 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-2f603ef2-3355-471a-8e07-4d8822af92e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:47.513780 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-2f603ef2-3355-471a-8e07-4d8822af92e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:47.515509 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-2f603ef2-3355-471a-8e07-4d8822af92e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:47.516695 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-2f603ef2-3355-471a-8e07-4d8822af92e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1405 microversion: 2.20 time: 0.357355 May 10 03:19:47.517260 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 69/132] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:19:47 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1405 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:47.525264 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-b378a215-478a-48a0-a39c-a166c7334e7a req-68bdb40a-2bd5-441d-9360-226a0bb510a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4227840d-36a9-472b-9c4b-984368ce0cea", "name": "network-vif-deleted", "tag": "a3b7916c-8ceb-428b-823b-ea9349841f8d"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:47.531655 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-b378a215-478a-48a0-a39c-a166c7334e7a req-68bdb40a-2bd5-441d-9360-226a0bb510a4 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:47.535150 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-b378a215-478a-48a0-a39c-a166c7334e7a req-68bdb40a-2bd5-441d-9360-226a0bb510a4 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:47.535371 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-de38bfa8-8484-4230-ab7f-42f24b746261 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:47.543479 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-de38bfa8-8484-4230-ab7f-42f24b746261 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1365 microversion: 2.1 time: 0.276454 May 10 03:19:47.544109 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 64/133] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:47 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:47.546191 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-b378a215-478a-48a0-a39c-a166c7334e7a req-68bdb40a-2bd5-441d-9360-226a0bb510a4 service nova] Creating event network-vif-deleted:a3b7916c-8ceb-428b-823b-ea9349841f8d for instance 4227840d-36a9-472b-9c4b-984368ce0cea on hv-cinder-83009 May 10 03:19:47.555676 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-b378a215-478a-48a0-a39c-a166c7334e7a req-68bdb40a-2bd5-441d-9360-226a0bb510a4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037260 May 10 03:19:47.556314 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 70/134] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:47.809573 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-0d23bd59-fe88-4177-a0cc-8a25cebfe240 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:47.809573 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-0d23bd59-fe88-4177-a0cc-8a25cebfe240 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:47.815623 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0d23bd59-fe88-4177-a0cc-8a25cebfe240 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:47.816104 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0d23bd59-fe88-4177-a0cc-8a25cebfe240 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:47.816879 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0d23bd59-fe88-4177-a0cc-8a25cebfe240 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:47.817355 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0d23bd59-fe88-4177-a0cc-8a25cebfe240 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:47.886648 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-0d23bd59-fe88-4177-a0cc-8a25cebfe240 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:47.894574 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-0d23bd59-fe88-4177-a0cc-8a25cebfe240 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1346 microversion: 2.1 time: 0.089999 May 10 03:19:47.895156 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 65/135] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:47 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:47.989282 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-41e4f108-9cb6-4460-b180-276c027476d2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:47.990083 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-41e4f108-9cb6-4460-b180-276c027476d2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:47.996820 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-41e4f108-9cb6-4460-b180-276c027476d2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:47.997337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-41e4f108-9cb6-4460-b180-276c027476d2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:47.998171 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-41e4f108-9cb6-4460-b180-276c027476d2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:47.998602 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-41e4f108-9cb6-4460-b180-276c027476d2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:48.136338 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-9fbab635-a8f1-42d3-b9d7-80e315feeddf tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:48.137322 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-9fbab635-a8f1-42d3-b9d7-80e315feeddf tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:48.144644 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-41e4f108-9cb6-4460-b180-276c027476d2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:48.153158 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9fbab635-a8f1-42d3-b9d7-80e315feeddf tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:48.153615 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9fbab635-a8f1-42d3-b9d7-80e315feeddf tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:48.154408 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9fbab635-a8f1-42d3-b9d7-80e315feeddf tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:48.154850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9fbab635-a8f1-42d3-b9d7-80e315feeddf tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:48.156403 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-41e4f108-9cb6-4460-b180-276c027476d2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1321 microversion: 2.1 time: 0.171841 May 10 03:19:48.166261 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 71/136] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:47 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:48.174130 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-9c903126-54ba-443f-a28a-2da0455f58e6 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:48.174867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-9c903126-54ba-443f-a28a-2da0455f58e6 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:48.185276 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9c903126-54ba-443f-a28a-2da0455f58e6 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:48.185903 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9c903126-54ba-443f-a28a-2da0455f58e6 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:48.186756 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9c903126-54ba-443f-a28a-2da0455f58e6 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:48.187289 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9c903126-54ba-443f-a28a-2da0455f58e6 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:48.238834 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-9fbab635-a8f1-42d3-b9d7-80e315feeddf tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b91d4485efb4a689a892233333959ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895dbe17859e43a18bb013a98f83a45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:48.250145 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-9fbab635-a8f1-42d3-b9d7-80e315feeddf tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064" status: 200 len: 1274 microversion: 2.1 time: 0.117889 May 10 03:19:48.250993 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 66/137] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:48 2022] GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 => generated 1274 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:48.344041 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-9c903126-54ba-443f-a28a-2da0455f58e6 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:48.352821 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-9c903126-54ba-443f-a28a-2da0455f58e6 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1548 microversion: 2.1 time: 0.182365 May 10 03:19:48.353481 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 72/138] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:48 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1548 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:48.369813 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-ceaa8e42-187a-45f4-ac07-4dbafd1aa6c9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:48.370298 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-ceaa8e42-187a-45f4-ac07-4dbafd1aa6c9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:48.376354 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ceaa8e42-187a-45f4-ac07-4dbafd1aa6c9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:48.376801 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ceaa8e42-187a-45f4-ac07-4dbafd1aa6c9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:48.377604 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ceaa8e42-187a-45f4-ac07-4dbafd1aa6c9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:48.378011 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ceaa8e42-187a-45f4-ac07-4dbafd1aa6c9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:48.477003 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-ceaa8e42-187a-45f4-ac07-4dbafd1aa6c9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110244 May 10 03:19:48.477721 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 67/139] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 10 03:19:48 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:48.536989 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-dc3a88ab-4230-41e8-bf62-30055861c018 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:48.537861 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-dc3a88ab-4230-41e8-bf62-30055861c018 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:48.552747 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dc3a88ab-4230-41e8-bf62-30055861c018 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:48.555475 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dc3a88ab-4230-41e8-bf62-30055861c018 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:48.557052 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dc3a88ab-4230-41e8-bf62-30055861c018 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:48.562361 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dc3a88ab-4230-41e8-bf62-30055861c018 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:48.562614 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-938e8678-02d2-4939-b09e-cfb3e29a9fcb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:48.562614 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-938e8678-02d2-4939-b09e-cfb3e29a9fcb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:48.574718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-938e8678-02d2-4939-b09e-cfb3e29a9fcb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:48.575195 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-938e8678-02d2-4939-b09e-cfb3e29a9fcb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:48.575987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-938e8678-02d2-4939-b09e-cfb3e29a9fcb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:48.576450 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-938e8678-02d2-4939-b09e-cfb3e29a9fcb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:48.895840 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-dc3a88ab-4230-41e8-bf62-30055861c018 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:48.904672 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-dc3a88ab-4230-41e8-bf62-30055861c018 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:48.906075 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-dc3a88ab-4230-41e8-bf62-30055861c018 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:48.907732 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-dc3a88ab-4230-41e8-bf62-30055861c018 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1405 microversion: 2.20 time: 0.376956 May 10 03:19:48.918478 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 73/140] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:19:48 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1405 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:48.918478 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-3b0da8ed-2b07-4a47-9600-5b62512dddcf tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:48.918478 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-3b0da8ed-2b07-4a47-9600-5b62512dddcf tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:48.923066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3b0da8ed-2b07-4a47-9600-5b62512dddcf tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:48.923066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3b0da8ed-2b07-4a47-9600-5b62512dddcf tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:48.923066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3b0da8ed-2b07-4a47-9600-5b62512dddcf tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:48.923066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3b0da8ed-2b07-4a47-9600-5b62512dddcf tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:48.957657 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-938e8678-02d2-4939-b09e-cfb3e29a9fcb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:48.965657 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-938e8678-02d2-4939-b09e-cfb3e29a9fcb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1365 microversion: 2.1 time: 0.408589 May 10 03:19:48.966561 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 68/141] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:48 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1365 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:49.080720 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-3b0da8ed-2b07-4a47-9600-5b62512dddcf tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:49.089450 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-3b0da8ed-2b07-4a47-9600-5b62512dddcf tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1346 microversion: 2.1 time: 0.179620 May 10 03:19:49.095414 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 74/142] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:48 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1346 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:49.173488 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-d023d84d-6fd6-406e-86cb-aeba80cd4d51 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:49.174313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-d023d84d-6fd6-406e-86cb-aeba80cd4d51 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:49.183742 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d023d84d-6fd6-406e-86cb-aeba80cd4d51 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:49.184223 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d023d84d-6fd6-406e-86cb-aeba80cd4d51 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:49.185236 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d023d84d-6fd6-406e-86cb-aeba80cd4d51 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:49.185825 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d023d84d-6fd6-406e-86cb-aeba80cd4d51 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:49.247604 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-a2894551-7d3c-4bf2-800c-f27b4c1e5d82 req-c2c50843-3014-408a-a8b8-e36f82478626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "544c3a1e-c28b-47ab-bf79-33a141cf9beb", "name": "network-vif-plugged", "status": "completed", "tag": "f0cb85c5-3fec-4e59-9a36-21921ca34926"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:49.255852 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-a2894551-7d3c-4bf2-800c-f27b4c1e5d82 req-c2c50843-3014-408a-a8b8-e36f82478626 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:49.256518 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-a2894551-7d3c-4bf2-800c-f27b4c1e5d82 req-c2c50843-3014-408a-a8b8-e36f82478626 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:49.270009 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-a2894551-7d3c-4bf2-800c-f27b4c1e5d82 req-c2c50843-3014-408a-a8b8-e36f82478626 service nova] Creating event network-vif-plugged:f0cb85c5-3fec-4e59-9a36-21921ca34926 for instance 544c3a1e-c28b-47ab-bf79-33a141cf9beb on hv-cinder-83009 May 10 03:19:49.275535 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-a2894551-7d3c-4bf2-800c-f27b4c1e5d82 req-c2c50843-3014-408a-a8b8-e36f82478626 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031503 May 10 03:19:49.276678 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 75/143] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:49.284826 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-58ef4967-9221-4145-8712-8f0401eead63 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:49.285542 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-58ef4967-9221-4145-8712-8f0401eead63 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:49.294512 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-58ef4967-9221-4145-8712-8f0401eead63 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:49.299243 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-58ef4967-9221-4145-8712-8f0401eead63 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:49.299243 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-58ef4967-9221-4145-8712-8f0401eead63 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:49.299243 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-58ef4967-9221-4145-8712-8f0401eead63 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:49.730436 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-58ef4967-9221-4145-8712-8f0401eead63 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b91d4485efb4a689a892233333959ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895dbe17859e43a18bb013a98f83a45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:49.737704 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-58ef4967-9221-4145-8712-8f0401eead63 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064" status: 200 len: 1274 microversion: 2.1 time: 0.459734 May 10 03:19:49.738317 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 76/144] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:49 2022] GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 => generated 1274 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:49.862040 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-d023d84d-6fd6-406e-86cb-aeba80cd4d51 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:49.870556 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-d023d84d-6fd6-406e-86cb-aeba80cd4d51 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1321 microversion: 2.1 time: 0.700693 May 10 03:19:49.879585 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 69/145] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:49 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1321 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:49.926277 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-b3f7d4c8-582d-4232-8148-99add0409d21 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:49.927105 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-b3f7d4c8-582d-4232-8148-99add0409d21 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:49.933620 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b3f7d4c8-582d-4232-8148-99add0409d21 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:49.934441 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b3f7d4c8-582d-4232-8148-99add0409d21 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:49.935416 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b3f7d4c8-582d-4232-8148-99add0409d21 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:49.936055 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b3f7d4c8-582d-4232-8148-99add0409d21 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:49.983237 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-1e008a0f-53f6-4f82-a8d7-503af6c3b29a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:49.983936 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-1e008a0f-53f6-4f82-a8d7-503af6c3b29a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:49.996961 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1e008a0f-53f6-4f82-a8d7-503af6c3b29a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:49.998161 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1e008a0f-53f6-4f82-a8d7-503af6c3b29a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:49.999255 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1e008a0f-53f6-4f82-a8d7-503af6c3b29a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:50.000294 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1e008a0f-53f6-4f82-a8d7-503af6c3b29a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:50.232452 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-b3f7d4c8-582d-4232-8148-99add0409d21 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:50.244288 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-b3f7d4c8-582d-4232-8148-99add0409d21 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:50.246031 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-b3f7d4c8-582d-4232-8148-99add0409d21 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:50.247881 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-b3f7d4c8-582d-4232-8148-99add0409d21 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1405 microversion: 2.20 time: 0.325182 May 10 03:19:50.248626 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 77/146] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:19:49 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1405 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:50.253313 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-baf23cfd-ad6d-4701-8b19-5c360fbac214 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:50.254064 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-baf23cfd-ad6d-4701-8b19-5c360fbac214 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:50.261986 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-baf23cfd-ad6d-4701-8b19-5c360fbac214 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:50.262641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-baf23cfd-ad6d-4701-8b19-5c360fbac214 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:50.264227 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-baf23cfd-ad6d-4701-8b19-5c360fbac214 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:50.264809 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-baf23cfd-ad6d-4701-8b19-5c360fbac214 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:50.298034 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-baf23cfd-ad6d-4701-8b19-5c360fbac214 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:50.298898 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-baf23cfd-ad6d-4701-8b19-5c360fbac214 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:50.299494 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.objects.instance [None req-baf23cfd-ad6d-4701-8b19-5c360fbac214 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lazy-loading 'fault' on Instance uuid 4227840d-36a9-472b-9c4b-984368ce0cea {{(pid=117399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:19:50.301082 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1e008a0f-53f6-4f82-a8d7-503af6c3b29a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:50.308600 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-1e008a0f-53f6-4f82-a8d7-503af6c3b29a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1365 microversion: 2.1 time: 0.329079 May 10 03:19:50.309371 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 70/147] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:49 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1365 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:50.371296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-baf23cfd-ad6d-4701-8b19-5c360fbac214 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:50.379655 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-baf23cfd-ad6d-4701-8b19-5c360fbac214 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1351 microversion: 2.1 time: 0.129743 May 10 03:19:50.380408 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 78/148] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:50 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1351 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:50.715172 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-3433a8b4-8bae-4c8e-95c0-14bde25f8990 req-ab2422e2-baae-48b1-86d9-7805c84a2c9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1813031a-ba52-4826-9b73-69ae2af70c13", "tag": "0b6928e9-9a74-46cf-b5b0-028b132f61ce"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:50.726469 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-3433a8b4-8bae-4c8e-95c0-14bde25f8990 req-ab2422e2-baae-48b1-86d9-7805c84a2c9d service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:50.727778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-3433a8b4-8bae-4c8e-95c0-14bde25f8990 req-ab2422e2-baae-48b1-86d9-7805c84a2c9d service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:50.747261 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-3433a8b4-8bae-4c8e-95c0-14bde25f8990 req-ab2422e2-baae-48b1-86d9-7805c84a2c9d service nova] Creating event network-changed:0b6928e9-9a74-46cf-b5b0-028b132f61ce for instance 1813031a-ba52-4826-9b73-69ae2af70c13 on hv-cinder-83009 May 10 03:19:50.754906 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-3c649554-ea5d-473f-a57a-0a5b1ec9ee50 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:50.755854 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-3c649554-ea5d-473f-a57a-0a5b1ec9ee50 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:50.764076 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-3433a8b4-8bae-4c8e-95c0-14bde25f8990 req-ab2422e2-baae-48b1-86d9-7805c84a2c9d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053648 May 10 03:19:50.765330 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 71/149] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:50.765438 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3c649554-ea5d-473f-a57a-0a5b1ec9ee50 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:50.766014 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3c649554-ea5d-473f-a57a-0a5b1ec9ee50 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:50.767106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3c649554-ea5d-473f-a57a-0a5b1ec9ee50 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:50.767761 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3c649554-ea5d-473f-a57a-0a5b1ec9ee50 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:50.832715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-3c649554-ea5d-473f-a57a-0a5b1ec9ee50 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b91d4485efb4a689a892233333959ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895dbe17859e43a18bb013a98f83a45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:50.840905 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-3c649554-ea5d-473f-a57a-0a5b1ec9ee50 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064" status: 200 len: 1272 microversion: 2.1 time: 0.090580 May 10 03:19:50.841590 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 79/150] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:50 2022] GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:50.888960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-2333d2b7-f1bd-4282-9e65-174a48910e23 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:50.889890 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-2333d2b7-f1bd-4282-9e65-174a48910e23 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:50.897484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2333d2b7-f1bd-4282-9e65-174a48910e23 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:50.898941 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2333d2b7-f1bd-4282-9e65-174a48910e23 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:50.899884 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2333d2b7-f1bd-4282-9e65-174a48910e23 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:50.900810 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2333d2b7-f1bd-4282-9e65-174a48910e23 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:51.116440 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-2333d2b7-f1bd-4282-9e65-174a48910e23 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:51.125227 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-2333d2b7-f1bd-4282-9e65-174a48910e23 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1321 microversion: 2.1 time: 0.241555 May 10 03:19:51.145805 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 72/151] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:50 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:51.266605 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-537f511b-b086-474a-a90e-8be9630c4e83 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:51.267351 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-537f511b-b086-474a-a90e-8be9630c4e83 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:51.273523 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-537f511b-b086-474a-a90e-8be9630c4e83 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:51.274137 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-537f511b-b086-474a-a90e-8be9630c4e83 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:51.274919 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-537f511b-b086-474a-a90e-8be9630c4e83 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:51.275356 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-537f511b-b086-474a-a90e-8be9630c4e83 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:51.326641 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-9e6b75ec-74d9-4810-a278-12a1d1f991c3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:51.335364 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-9e6b75ec-74d9-4810-a278-12a1d1f991c3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:51.350595 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9e6b75ec-74d9-4810-a278-12a1d1f991c3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:51.356334 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9e6b75ec-74d9-4810-a278-12a1d1f991c3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:51.357533 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9e6b75ec-74d9-4810-a278-12a1d1f991c3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:51.360642 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9e6b75ec-74d9-4810-a278-12a1d1f991c3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:51.537218 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-537f511b-b086-474a-a90e-8be9630c4e83 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:51.560302 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-537f511b-b086-474a-a90e-8be9630c4e83 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:51.562891 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-537f511b-b086-474a-a90e-8be9630c4e83 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:51.564164 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-537f511b-b086-474a-a90e-8be9630c4e83 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1405 microversion: 2.20 time: 0.302120 May 10 03:19:51.570810 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 80/152] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:19:51 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1405 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:51.587255 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-28f07919-0840-4014-a43a-ac48f209e348 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:51.587255 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-28f07919-0840-4014-a43a-ac48f209e348 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:51.597568 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-28f07919-0840-4014-a43a-ac48f209e348 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:51.598027 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-28f07919-0840-4014-a43a-ac48f209e348 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:51.598299 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-9e6b75ec-74d9-4810-a278-12a1d1f991c3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:51.598855 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-28f07919-0840-4014-a43a-ac48f209e348 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:51.599298 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-28f07919-0840-4014-a43a-ac48f209e348 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:51.610263 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-9e6b75ec-74d9-4810-a278-12a1d1f991c3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1365 microversion: 2.1 time: 0.284185 May 10 03:19:51.610263 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 73/153] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:51 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1365 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:51.643303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-28f07919-0840-4014-a43a-ac48f209e348 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:51.643867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-28f07919-0840-4014-a43a-ac48f209e348 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:51.644352 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.objects.instance [None req-28f07919-0840-4014-a43a-ac48f209e348 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lazy-loading 'fault' on Instance uuid 4227840d-36a9-472b-9c4b-984368ce0cea {{(pid=117399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:19:51.697579 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-28f07919-0840-4014-a43a-ac48f209e348 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637ea3672264d8c85cd8c32c1f38423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9244cbe8f30144d984cfc43e3cbb5f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:51.707182 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-28f07919-0840-4014-a43a-ac48f209e348 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 200 len: 1351 microversion: 2.1 time: 0.134944 May 10 03:19:51.712172 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 81/154] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:51 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 1351 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:51.860149 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-cf04eb76-1c94-41c2-aef4-e6dc0b6be374 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:51.861479 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-cf04eb76-1c94-41c2-aef4-e6dc0b6be374 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:51.870847 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cf04eb76-1c94-41c2-aef4-e6dc0b6be374 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:51.871896 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cf04eb76-1c94-41c2-aef4-e6dc0b6be374 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:51.873870 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cf04eb76-1c94-41c2-aef4-e6dc0b6be374 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:51.875146 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cf04eb76-1c94-41c2-aef4-e6dc0b6be374 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:52.082683 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-cf04eb76-1c94-41c2-aef4-e6dc0b6be374 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b91d4485efb4a689a892233333959ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895dbe17859e43a18bb013a98f83a45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:52.091625 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-cf04eb76-1c94-41c2-aef4-e6dc0b6be374 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064" status: 200 len: 1314 microversion: 2.1 time: 0.235888 May 10 03:19:52.092575 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 74/155] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:51 2022] GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:52.153964 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-b081315c-2530-4376-b79e-4e3d3891f96f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:52.154547 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-b081315c-2530-4376-b79e-4e3d3891f96f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:52.160498 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b081315c-2530-4376-b79e-4e3d3891f96f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:52.160946 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b081315c-2530-4376-b79e-4e3d3891f96f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:52.161707 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b081315c-2530-4376-b79e-4e3d3891f96f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:52.162146 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b081315c-2530-4376-b79e-4e3d3891f96f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:52.267462 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-ba29dc12-5a69-4491-ac05-6e178aefbe91 req-a98f9b9e-da96-4c9a-8c84-aabad4ca7dff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a09699c-5e60-48a3-884c-79e14f39b064", "tag": "245e8602-9f45-4d84-af6e-756d98bc51c4"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:52.288294 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-ba29dc12-5a69-4491-ac05-6e178aefbe91 req-a98f9b9e-da96-4c9a-8c84-aabad4ca7dff service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:52.289746 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-ba29dc12-5a69-4491-ac05-6e178aefbe91 req-a98f9b9e-da96-4c9a-8c84-aabad4ca7dff service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:52.324953 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-ba29dc12-5a69-4491-ac05-6e178aefbe91 req-a98f9b9e-da96-4c9a-8c84-aabad4ca7dff service nova] Creating event network-changed:245e8602-9f45-4d84-af6e-756d98bc51c4 for instance 2a09699c-5e60-48a3-884c-79e14f39b064 on hv-cinder-83009 May 10 03:19:52.340549 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-ba29dc12-5a69-4491-ac05-6e178aefbe91 req-a98f9b9e-da96-4c9a-8c84-aabad4ca7dff service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083463 May 10 03:19:52.341453 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 75/156] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:52.398953 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-b081315c-2530-4376-b79e-4e3d3891f96f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:52.410575 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-b081315c-2530-4376-b79e-4e3d3891f96f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1515 microversion: 2.1 time: 0.260753 May 10 03:19:52.420791 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 82/157] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:52 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1515 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:52.431955 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-79c882d5-8238-4a46-806e-39130bb61a32 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:52.433098 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-79c882d5-8238-4a46-806e-39130bb61a32 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:52.446577 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-79c882d5-8238-4a46-806e-39130bb61a32 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:52.447040 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-79c882d5-8238-4a46-806e-39130bb61a32 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:52.447842 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-79c882d5-8238-4a46-806e-39130bb61a32 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:52.450410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-79c882d5-8238-4a46-806e-39130bb61a32 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:52.494663 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.objects.instance [None req-79c882d5-8238-4a46-806e-39130bb61a32 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lazy-loading 'flavor' on Instance uuid 544c3a1e-c28b-47ab-bf79-33a141cf9beb {{(pid=117400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:19:52.588125 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-0c06b741-607a-496d-ad84-c6dce764fb02 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:52.589636 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-0c06b741-607a-496d-ad84-c6dce764fb02 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:52.601859 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0c06b741-607a-496d-ad84-c6dce764fb02 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:52.602371 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0c06b741-607a-496d-ad84-c6dce764fb02 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:52.603197 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0c06b741-607a-496d-ad84-c6dce764fb02 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:52.603632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0c06b741-607a-496d-ad84-c6dce764fb02 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:52.795495 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-0c06b741-607a-496d-ad84-c6dce764fb02 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:52.843082 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-0c06b741-607a-496d-ad84-c6dce764fb02 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:52.844961 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-0c06b741-607a-496d-ad84-c6dce764fb02 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:52.847404 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-0c06b741-607a-496d-ad84-c6dce764fb02 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1597 microversion: 2.20 time: 0.268845 May 10 03:19:52.854093 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 83/158] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:19:52 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1597 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:19:52.863388 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-5c1d850a-52a5-4f75-a14b-4dcb6daa80f7 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:52.866151 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-5c1d850a-52a5-4f75-a14b-4dcb6daa80f7 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:52.880124 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5c1d850a-52a5-4f75-a14b-4dcb6daa80f7 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:52.881387 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5c1d850a-52a5-4f75-a14b-4dcb6daa80f7 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:52.882503 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5c1d850a-52a5-4f75-a14b-4dcb6daa80f7 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:52.883064 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5c1d850a-52a5-4f75-a14b-4dcb6daa80f7 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:53.071725 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-5c1d850a-52a5-4f75-a14b-4dcb6daa80f7 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:53.079953 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-5c1d850a-52a5-4f75-a14b-4dcb6daa80f7 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1365 microversion: 2.1 time: 0.224573 May 10 03:19:53.081091 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 84/159] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:52 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:53.086175 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a84fffd7-0d66-4fa9-9330-7342c30f7a80 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:53.087035 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-a84fffd7-0d66-4fa9-9330-7342c30f7a80 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:53.102935 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a84fffd7-0d66-4fa9-9330-7342c30f7a80 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:53.102935 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a84fffd7-0d66-4fa9-9330-7342c30f7a80 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:53.102935 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a84fffd7-0d66-4fa9-9330-7342c30f7a80 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:53.102935 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a84fffd7-0d66-4fa9-9330-7342c30f7a80 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:53.116301 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-a84fffd7-0d66-4fa9-9330-7342c30f7a80 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] HTTP exception thrown: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. May 10 03:19:53.121066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a84fffd7-0d66-4fa9-9330-7342c30f7a80 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Request method failure captured: May 10 03:19:53.121066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea HTTP/1.1 May 10 03:19:53.121066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:19:53.121066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:19:53.121066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:19:53.121066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:19:53.121066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:19:53.121066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:19:53.121066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:19:53.121066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:19:53.121066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedmhlW8dvMWe_xuooz1S6zB4uC0m0aJsSCwxg1D4idBZnRsZsOjDPbasPHlk-rcj0mBRaGUneaNbhExYAhPqGGu0v-oD49DhyYmm4L0FqbCIP6c0ZACoyWtyLjlNYLBD3KlWOAGecqnsg3wcpw7Fkrp4WelSCG_jCsTq5mlSNKWOHlo May 10 03:19:53.121066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:19:53.121066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:19:53.121066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:19:53.121066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:19:53.121066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:19:53.121066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:19:53.121066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: 9244cbe8f30144d984cfc43e3cbb5f4a May 10 03:19:53.121066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-DeleteServersTestJSON-830513180 May 10 03:19:53.121066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:19:53.121066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:19:53.122409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9244cbe8f30144d984cfc43e3cbb5f4a", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9244cbe8f30144d984cfc43e3cbb5f4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9244cbe8f30144d984cfc43e3cbb5f4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9244cbe8f30144d984cfc43e3cbb5f4a"}]}] May 10 03:19:53.122409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-DeleteServersTestJSON-830513180 May 10 03:19:53.122409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: 9244cbe8f30144d984cfc43e3cbb5f4a May 10 03:19:53.122409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-DeleteServersTestJSON-830513180 May 10 03:19:53.122409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-DeleteServersTestJSON-830513180-project May 10 03:19:53.122409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:19:53.122409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:19:53.122409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: 2637ea3672264d8c85cd8c32c1f38423 May 10 03:19:53.122409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-DeleteServersTestJSON-830513180-project May 10 03:19:53.122409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: > May 10 03:19:53.122409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. May 10 03:19:53.122409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': '4227840d-36a9-472b-9c4b-984368ce0cea'} May 10 03:19:53.123068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:19:53.123068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:53.123068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:19:53.123068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:19:53.123068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:19:53.123068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:19:53.123068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:19:53.123068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:19:53.123068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:19:53.123068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:19:53.123068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. May 10 03:19:53.123068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:53.123068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:53.123068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:53.123068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:53.123068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:53.123068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:53.123068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:19:53.123068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:19:53.123068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:19:53.124979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:19:53.124979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:19:53.124979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:19:53.124979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:19:53.124979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:19:53.124979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:19:53.124979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:19:53.124979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. May 10 03:19:53.124979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:53.124979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:53.124979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:53.124979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:53.124979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:53.124979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:53.124979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:19:53.124979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:19:53.124979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. May 10 03:19:53.124979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:19:53.126049 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a84fffd7-0d66-4fa9-9330-7342c30f7a80 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Returning 404 to user: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:19:53.126049 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-a84fffd7-0d66-4fa9-9330-7342c30f7a80 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 404 len: 111 microversion: 2.1 time: 0.040554 May 10 03:19:53.126049 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 85/160] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:53 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:19:53.128661 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-b75c999c-9b21-413f-917d-f71d9d87adf3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:53.129349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-b75c999c-9b21-413f-917d-f71d9d87adf3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:53.136864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b75c999c-9b21-413f-917d-f71d9d87adf3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:53.137780 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b75c999c-9b21-413f-917d-f71d9d87adf3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:53.138215 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b75c999c-9b21-413f-917d-f71d9d87adf3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:53.139482 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b75c999c-9b21-413f-917d-f71d9d87adf3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:53.198407 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-79c882d5-8238-4a46-806e-39130bb61a32 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "POST /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb/action" status: 200 len: 32 microversion: 2.1 time: 0.772627 May 10 03:19:53.200753 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 76/161] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 03:19:52 2022] POST /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb/action => generated 32 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:19:53.215086 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-6240eb82-f5d5-4d9c-ba36-6a8e72d20118 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:53.217834 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-6240eb82-f5d5-4d9c-ba36-6a8e72d20118 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:53.236094 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6240eb82-f5d5-4d9c-ba36-6a8e72d20118 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:53.238493 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6240eb82-f5d5-4d9c-ba36-6a8e72d20118 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:53.239478 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6240eb82-f5d5-4d9c-ba36-6a8e72d20118 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:53.239948 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6240eb82-f5d5-4d9c-ba36-6a8e72d20118 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:53.352780 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-b75c999c-9b21-413f-917d-f71d9d87adf3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.226897 May 10 03:19:53.354813 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 86/162] 10.222.0.65 () {60 vars in 1315 bytes} [Tue May 10 03:19:53 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636/os-interface => generated 284 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:19:53.366615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-9b9e6fac-828a-4c7b-826d-18282b98c534 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:53.372603 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-9b9e6fac-828a-4c7b-826d-18282b98c534 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:53.381669 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9b9e6fac-828a-4c7b-826d-18282b98c534 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:53.383063 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9b9e6fac-828a-4c7b-826d-18282b98c534 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:53.384210 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9b9e6fac-828a-4c7b-826d-18282b98c534 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:53.385083 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9b9e6fac-828a-4c7b-826d-18282b98c534 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:53.467597 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-6240eb82-f5d5-4d9c-ba36-6a8e72d20118 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b91d4485efb4a689a892233333959ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895dbe17859e43a18bb013a98f83a45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:53.482258 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-6240eb82-f5d5-4d9c-ba36-6a8e72d20118 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064" status: 200 len: 1314 microversion: 2.1 time: 0.279863 May 10 03:19:53.483020 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 77/163] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:53 2022] GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:53.496174 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-9b89425b-a3af-41f4-be87-626245aae63b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:53.497922 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-9b89425b-a3af-41f4-be87-626245aae63b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:53.505694 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9b89425b-a3af-41f4-be87-626245aae63b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:53.506594 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9b89425b-a3af-41f4-be87-626245aae63b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:53.509018 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9b89425b-a3af-41f4-be87-626245aae63b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:53.509533 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9b89425b-a3af-41f4-be87-626245aae63b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:53.524831 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-9b89425b-a3af-41f4-be87-626245aae63b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] HTTP exception thrown: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. May 10 03:19:53.539651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-9b89425b-a3af-41f4-be87-626245aae63b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Request method failure captured: May 10 03:19:53.539651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea/os-volume_attachments HTTP/1.1 May 10 03:19:53.539651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:19:53.539651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:19:53.539651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:19:53.539651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:19:53.539651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:19:53.539651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:19:53.539651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:19:53.539651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:19:53.539651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedmhlW8dvMWe_xuooz1S6zB4uC0m0aJsSCwxg1D4idBZnRsZsOjDPbasPHlk-rcj0mBRaGUneaNbhExYAhPqGGu0v-oD49DhyYmm4L0FqbCIP6c0ZACoyWtyLjlNYLBD3KlWOAGecqnsg3wcpw7Fkrp4WelSCG_jCsTq5mlSNKWOHlo May 10 03:19:53.539651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:19:53.539651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:19:53.539651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:19:53.539651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:19:53.539651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:19:53.539651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:19:53.539651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: 9244cbe8f30144d984cfc43e3cbb5f4a May 10 03:19:53.539651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-DeleteServersTestJSON-830513180 May 10 03:19:53.539651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:19:53.539651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:19:53.541981 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9244cbe8f30144d984cfc43e3cbb5f4a", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9244cbe8f30144d984cfc43e3cbb5f4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9244cbe8f30144d984cfc43e3cbb5f4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9244cbe8f30144d984cfc43e3cbb5f4a"}]}] May 10 03:19:53.541981 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-DeleteServersTestJSON-830513180 May 10 03:19:53.541981 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: 9244cbe8f30144d984cfc43e3cbb5f4a May 10 03:19:53.541981 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-DeleteServersTestJSON-830513180 May 10 03:19:53.541981 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-DeleteServersTestJSON-830513180-project May 10 03:19:53.541981 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:19:53.541981 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:19:53.541981 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: 2637ea3672264d8c85cd8c32c1f38423 May 10 03:19:53.541981 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-DeleteServersTestJSON-830513180-project May 10 03:19:53.541981 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:19:53.541981 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. May 10 03:19:53.541981 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'server_id': '4227840d-36a9-472b-9c4b-984368ce0cea'} May 10 03:19:53.543279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:19:53.543279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:53.543279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:19:53.543279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:19:53.543279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:19:53.543279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:19:53.543279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:19:53.543279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:19:53.543279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:19:53.543279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:19:53.543279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. May 10 03:19:53.543279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:19:53.543279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:53.543279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:19:53.543279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:53.543279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:53.543279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:53.543279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:19:53.543279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:19:53.543279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:19:53.544999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:19:53.544999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 03:19:53.544999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:19:53.544999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 03:19:53.544999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:19:53.544999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 10 03:19:53.544999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 10 03:19:53.544999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:19:53.544999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:19:53.544999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. May 10 03:19:53.544999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:19:53.544999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:53.544999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:19:53.544999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:53.544999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:53.544999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:53.544999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:19:53.544999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:19:53.544999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. May 10 03:19:53.544999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:19:53.546137 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-9b89425b-a3af-41f4-be87-626245aae63b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Returning 404 to user: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:19:53.546137 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-9b89425b-a3af-41f4-be87-626245aae63b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.052976 May 10 03:19:53.546137 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 78/164] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 03:19:53 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea/os-volume_attachments => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:19:53.556967 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-9b9e6fac-828a-4c7b-826d-18282b98c534 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:53.569520 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-9b9e6fac-828a-4c7b-826d-18282b98c534 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.212518 May 10 03:19:53.571703 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 87/165] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:53 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:54.097499 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-b51b1f6b-4492-40c2-ab6b-d2bcbb74b191 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:54.098112 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-b51b1f6b-4492-40c2-ab6b-d2bcbb74b191 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:54.105018 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b51b1f6b-4492-40c2-ab6b-d2bcbb74b191 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:54.105473 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b51b1f6b-4492-40c2-ab6b-d2bcbb74b191 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:54.106633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b51b1f6b-4492-40c2-ab6b-d2bcbb74b191 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:54.107075 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b51b1f6b-4492-40c2-ab6b-d2bcbb74b191 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:54.250573 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-b51b1f6b-4492-40c2-ab6b-d2bcbb74b191 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:54.259901 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-b51b1f6b-4492-40c2-ab6b-d2bcbb74b191 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1365 microversion: 2.1 time: 0.166193 May 10 03:19:54.269487 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 79/166] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:54 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:54.499330 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-f8693fa9-cbee-4d8a-9e7e-48547aaca5cc tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:54.499935 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-f8693fa9-cbee-4d8a-9e7e-48547aaca5cc tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:54.506579 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f8693fa9-cbee-4d8a-9e7e-48547aaca5cc tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:54.507199 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f8693fa9-cbee-4d8a-9e7e-48547aaca5cc tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:54.508114 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f8693fa9-cbee-4d8a-9e7e-48547aaca5cc tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:54.508549 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f8693fa9-cbee-4d8a-9e7e-48547aaca5cc tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:54.588944 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a5a92004-a9a5-43a1-9cb5-19e2be289cc7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:54.591439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-a5a92004-a9a5-43a1-9cb5-19e2be289cc7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:54.597490 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a5a92004-a9a5-43a1-9cb5-19e2be289cc7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:54.598441 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a5a92004-a9a5-43a1-9cb5-19e2be289cc7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:54.600466 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a5a92004-a9a5-43a1-9cb5-19e2be289cc7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:54.601076 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a5a92004-a9a5-43a1-9cb5-19e2be289cc7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:54.751199 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-f8693fa9-cbee-4d8a-9e7e-48547aaca5cc tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b91d4485efb4a689a892233333959ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895dbe17859e43a18bb013a98f83a45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:54.767857 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-f8693fa9-cbee-4d8a-9e7e-48547aaca5cc tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064" status: 200 len: 1314 microversion: 2.1 time: 0.272084 May 10 03:19:54.768898 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 88/167] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:54 2022] GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:54.774753 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-75fe8faa-e26f-4dd4-a8b2-0e88dfacfe77 req-f700bcfd-42c5-4235-9872-11111e45f10a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a275173c-51a6-4cc6-aef2-b30bcee8b67b", "name": "network-vif-plugged", "status": "completed", "tag": "3675090a-d6b4-4972-9846-20ea88eb78e8"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:54.791638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-75fe8faa-e26f-4dd4-a8b2-0e88dfacfe77 req-f700bcfd-42c5-4235-9872-11111e45f10a service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:54.791638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-75fe8faa-e26f-4dd4-a8b2-0e88dfacfe77 req-f700bcfd-42c5-4235-9872-11111e45f10a service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:54.806042 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-75fe8faa-e26f-4dd4-a8b2-0e88dfacfe77 req-f700bcfd-42c5-4235-9872-11111e45f10a service nova] Creating event network-vif-plugged:3675090a-d6b4-4972-9846-20ea88eb78e8 for instance a275173c-51a6-4cc6-aef2-b30bcee8b67b on hv-cinder-83009 May 10 03:19:54.812120 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-75fe8faa-e26f-4dd4-a8b2-0e88dfacfe77 req-f700bcfd-42c5-4235-9872-11111e45f10a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041901 May 10 03:19:54.816023 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 89/168] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:54.852624 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-a5a92004-a9a5-43a1-9cb5-19e2be289cc7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:54.861487 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-a5a92004-a9a5-43a1-9cb5-19e2be289cc7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.278552 May 10 03:19:54.863057 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 80/169] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:54 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:55.277983 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-97d14e9b-6829-47d9-8f09-768ab6e2bd5f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:55.278996 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-97d14e9b-6829-47d9-8f09-768ab6e2bd5f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:55.291865 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-428c0f11-ebc6-43ec-bdc2-998f8d96d713 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:55.296491 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-428c0f11-ebc6-43ec-bdc2-998f8d96d713 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:55.299294 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-97d14e9b-6829-47d9-8f09-768ab6e2bd5f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:55.299737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-97d14e9b-6829-47d9-8f09-768ab6e2bd5f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:55.300872 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-97d14e9b-6829-47d9-8f09-768ab6e2bd5f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:55.301460 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-97d14e9b-6829-47d9-8f09-768ab6e2bd5f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:55.302934 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-428c0f11-ebc6-43ec-bdc2-998f8d96d713 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:55.304592 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-428c0f11-ebc6-43ec-bdc2-998f8d96d713 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:55.307523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-428c0f11-ebc6-43ec-bdc2-998f8d96d713 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:55.308200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-428c0f11-ebc6-43ec-bdc2-998f8d96d713 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:55.325902 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-428c0f11-ebc6-43ec-bdc2-998f8d96d713 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] HTTP exception thrown: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. May 10 03:19:55.332186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-428c0f11-ebc6-43ec-bdc2-998f8d96d713 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Request method failure captured: May 10 03:19:55.332186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: DELETE /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea HTTP/1.1 May 10 03:19:55.332186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:19:55.332186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:19:55.332186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:19:55.332186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:19:55.332186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:19:55.332186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:19:55.332186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:19:55.332186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:19:55.332186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedmhlW8dvMWe_xuooz1S6zB4uC0m0aJsSCwxg1D4idBZnRsZsOjDPbasPHlk-rcj0mBRaGUneaNbhExYAhPqGGu0v-oD49DhyYmm4L0FqbCIP6c0ZACoyWtyLjlNYLBD3KlWOAGecqnsg3wcpw7Fkrp4WelSCG_jCsTq5mlSNKWOHlo May 10 03:19:55.332186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:19:55.332186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:19:55.332186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:19:55.332186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:19:55.332186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:19:55.332186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:19:55.332186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: 9244cbe8f30144d984cfc43e3cbb5f4a May 10 03:19:55.332186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-DeleteServersTestJSON-830513180 May 10 03:19:55.332186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:19:55.332186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:19:55.333668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9244cbe8f30144d984cfc43e3cbb5f4a", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9244cbe8f30144d984cfc43e3cbb5f4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9244cbe8f30144d984cfc43e3cbb5f4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9244cbe8f30144d984cfc43e3cbb5f4a"}]}] May 10 03:19:55.333668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-DeleteServersTestJSON-830513180 May 10 03:19:55.333668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: 9244cbe8f30144d984cfc43e3cbb5f4a May 10 03:19:55.333668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-DeleteServersTestJSON-830513180 May 10 03:19:55.333668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-DeleteServersTestJSON-830513180-project May 10 03:19:55.333668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:19:55.333668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:19:55.333668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: 2637ea3672264d8c85cd8c32c1f38423 May 10 03:19:55.333668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-DeleteServersTestJSON-830513180-project May 10 03:19:55.333668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:19:55.333668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. May 10 03:19:55.333668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'id': '4227840d-36a9-472b-9c4b-984368ce0cea'} May 10 03:19:55.334559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:19:55.334559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:55.334559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:19:55.334559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:19:55.334559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:19:55.334559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:19:55.334559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:19:55.334559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:19:55.334559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:19:55.334559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:19:55.334559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. May 10 03:19:55.334559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:19:55.334559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:55.334559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:19:55.334559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:55.334559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:55.334559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:55.334559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:19:55.334559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:19:55.334559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:19:55.336591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:19:55.336591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:19:55.336591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:19:55.336591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:19:55.336591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:19:55.336591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:19:55.336591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:19:55.336591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:19:55.336591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:19:55.336591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. May 10 03:19:55.336591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:19:55.336591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:55.336591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:19:55.336591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:55.336591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:55.336591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:55.336591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:19:55.336591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:19:55.336591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. May 10 03:19:55.336591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:19:55.337903 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-428c0f11-ebc6-43ec-bdc2-998f8d96d713 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Returning 404 to user: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:19:55.337903 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-428c0f11-ebc6-43ec-bdc2-998f8d96d713 tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 404 len: 111 microversion: 2.1 time: 0.042690 May 10 03:19:55.337903 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 81/170] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:19:55 2022] DELETE /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 03:19:55.343278 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-54b170a5-c278-4a81-9d5a-e9f78683515b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:55.343971 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-54b170a5-c278-4a81-9d5a-e9f78683515b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] [instance: 4227840d-36a9-472b-9c4b-984368ce0cea] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:55.350527 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-54b170a5-c278-4a81-9d5a-e9f78683515b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:55.351086 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-54b170a5-c278-4a81-9d5a-e9f78683515b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:55.352058 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-54b170a5-c278-4a81-9d5a-e9f78683515b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:55.352586 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-54b170a5-c278-4a81-9d5a-e9f78683515b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:55.369499 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-54b170a5-c278-4a81-9d5a-e9f78683515b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] HTTP exception thrown: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. May 10 03:19:55.371029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-54b170a5-c278-4a81-9d5a-e9f78683515b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Request method failure captured: May 10 03:19:55.371029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea HTTP/1.1 May 10 03:19:55.371029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:19:55.371029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:19:55.371029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:19:55.371029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:19:55.371029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:19:55.371029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:19:55.371029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:19:55.371029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:19:55.371029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedmhlW8dvMWe_xuooz1S6zB4uC0m0aJsSCwxg1D4idBZnRsZsOjDPbasPHlk-rcj0mBRaGUneaNbhExYAhPqGGu0v-oD49DhyYmm4L0FqbCIP6c0ZACoyWtyLjlNYLBD3KlWOAGecqnsg3wcpw7Fkrp4WelSCG_jCsTq5mlSNKWOHlo May 10 03:19:55.371029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:19:55.371029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:19:55.371029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:19:55.371029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:19:55.371029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:19:55.371029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:19:55.371029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: 9244cbe8f30144d984cfc43e3cbb5f4a May 10 03:19:55.371029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-DeleteServersTestJSON-830513180 May 10 03:19:55.371029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:19:55.371029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:19:55.372322 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9244cbe8f30144d984cfc43e3cbb5f4a", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9244cbe8f30144d984cfc43e3cbb5f4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9244cbe8f30144d984cfc43e3cbb5f4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9244cbe8f30144d984cfc43e3cbb5f4a"}]}] May 10 03:19:55.372322 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-DeleteServersTestJSON-830513180 May 10 03:19:55.372322 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: 9244cbe8f30144d984cfc43e3cbb5f4a May 10 03:19:55.372322 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-DeleteServersTestJSON-830513180 May 10 03:19:55.372322 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-DeleteServersTestJSON-830513180-project May 10 03:19:55.372322 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:19:55.372322 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:19:55.372322 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: 2637ea3672264d8c85cd8c32c1f38423 May 10 03:19:55.372322 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-DeleteServersTestJSON-830513180-project May 10 03:19:55.372322 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:19:55.372322 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. May 10 03:19:55.372322 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'id': '4227840d-36a9-472b-9c4b-984368ce0cea'} May 10 03:19:55.373008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:19:55.373008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:55.373008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:19:55.373008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:19:55.373008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:19:55.373008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:19:55.373008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:19:55.373008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:19:55.373008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:19:55.373008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:19:55.373008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. May 10 03:19:55.373008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:19:55.373008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:55.373008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:19:55.373008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:55.373008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:55.373008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:55.373008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:19:55.373008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:19:55.373008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:19:55.374017 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:19:55.374017 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:19:55.374017 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:19:55.374017 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:19:55.374017 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:19:55.374017 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:19:55.374017 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:19:55.374017 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. May 10 03:19:55.374017 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:19:55.374017 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:19:55.374017 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:19:55.374017 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:19:55.374017 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:19:55.374017 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:19:55.374017 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:19:55.374017 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:19:55.374017 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. May 10 03:19:55.374017 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:19:55.375139 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-54b170a5-c278-4a81-9d5a-e9f78683515b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] Returning 404 to user: Instance 4227840d-36a9-472b-9c4b-984368ce0cea could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:19:55.375139 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-54b170a5-c278-4a81-9d5a-e9f78683515b tempest-DeleteServersTestJSON-830513180 tempest-DeleteServersTestJSON-830513180-project] 10.222.0.65 "GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea" status: 404 len: 111 microversion: 2.1 time: 0.033453 May 10 03:19:55.375139 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 82/171] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:55 2022] GET /compute/v2.1/servers/4227840d-36a9-472b-9c4b-984368ce0cea => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:19:55.555690 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-97d14e9b-6829-47d9-8f09-768ab6e2bd5f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:55.567318 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-97d14e9b-6829-47d9-8f09-768ab6e2bd5f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1365 microversion: 2.1 time: 0.294174 May 10 03:19:55.568616 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 90/172] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:55 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:55.689902 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-1d9267b8-d906-4cec-b931-34e43d9ce495 req-bb5aa926-57a4-4fe2-b800-f95974a6824c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8796004-8adb-4534-a094-c62dfd2a9636", "tag": "373a71b7-374a-4584-ad6b-1d09a234ef37"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:55.699326 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-1d9267b8-d906-4cec-b931-34e43d9ce495 req-bb5aa926-57a4-4fe2-b800-f95974a6824c service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:55.699946 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-1d9267b8-d906-4cec-b931-34e43d9ce495 req-bb5aa926-57a4-4fe2-b800-f95974a6824c service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:55.722448 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-1d9267b8-d906-4cec-b931-34e43d9ce495 req-bb5aa926-57a4-4fe2-b800-f95974a6824c service nova] Creating event network-changed:373a71b7-374a-4584-ad6b-1d09a234ef37 for instance e8796004-8adb-4534-a094-c62dfd2a9636 on hv-cinder-83009 May 10 03:19:55.728889 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-1d9267b8-d906-4cec-b931-34e43d9ce495 req-bb5aa926-57a4-4fe2-b800-f95974a6824c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044353 May 10 03:19:55.730167 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 83/173] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:19:55.793796 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-eb0fca0f-c34d-4767-a045-fcc1cd693e88 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:55.795764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-eb0fca0f-c34d-4767-a045-fcc1cd693e88 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:55.820914 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-eb0fca0f-c34d-4767-a045-fcc1cd693e88 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:55.828139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-eb0fca0f-c34d-4767-a045-fcc1cd693e88 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:55.828139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-eb0fca0f-c34d-4767-a045-fcc1cd693e88 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:55.828139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-eb0fca0f-c34d-4767-a045-fcc1cd693e88 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:55.879697 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-b75a1237-b6b4-4024-a055-3e4fb90c1fd0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:55.880532 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-b75a1237-b6b4-4024-a055-3e4fb90c1fd0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:55.888266 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b75a1237-b6b4-4024-a055-3e4fb90c1fd0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:55.898465 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b75a1237-b6b4-4024-a055-3e4fb90c1fd0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:55.898465 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b75a1237-b6b4-4024-a055-3e4fb90c1fd0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:55.898465 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b75a1237-b6b4-4024-a055-3e4fb90c1fd0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:56.123161 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-b75a1237-b6b4-4024-a055-3e4fb90c1fd0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:56.131443 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-eb0fca0f-c34d-4767-a045-fcc1cd693e88 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b91d4485efb4a689a892233333959ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895dbe17859e43a18bb013a98f83a45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:56.140901 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-eb0fca0f-c34d-4767-a045-fcc1cd693e88 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064" status: 200 len: 1314 microversion: 2.1 time: 0.358727 May 10 03:19:56.144936 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-b75a1237-b6b4-4024-a055-3e4fb90c1fd0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.270007 May 10 03:19:56.145704 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 91/174] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:55 2022] GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:56.146405 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 84/175] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:55 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:56.588956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-3ca272ab-1fc5-4f2e-8d92-806f147dc0cb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:56.589835 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-3ca272ab-1fc5-4f2e-8d92-806f147dc0cb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:56.597996 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3ca272ab-1fc5-4f2e-8d92-806f147dc0cb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:56.598117 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3ca272ab-1fc5-4f2e-8d92-806f147dc0cb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:56.598862 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3ca272ab-1fc5-4f2e-8d92-806f147dc0cb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:56.599458 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3ca272ab-1fc5-4f2e-8d92-806f147dc0cb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:56.774853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-3ca272ab-1fc5-4f2e-8d92-806f147dc0cb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:56.782493 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-3ca272ab-1fc5-4f2e-8d92-806f147dc0cb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1365 microversion: 2.1 time: 0.199076 May 10 03:19:56.783154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 85/176] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:56 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:57.167665 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-58caea45-cd87-4aa8-a027-7c9e6b251c78 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:57.168776 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-2a1a08bd-79b9-4823-8df1-e2b4a3979e6a tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:57.170514 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-58caea45-cd87-4aa8-a027-7c9e6b251c78 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:57.172418 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-2a1a08bd-79b9-4823-8df1-e2b4a3979e6a tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:57.186535 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-58caea45-cd87-4aa8-a027-7c9e6b251c78 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:57.188156 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-58caea45-cd87-4aa8-a027-7c9e6b251c78 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:57.189049 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-58caea45-cd87-4aa8-a027-7c9e6b251c78 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:57.189497 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-58caea45-cd87-4aa8-a027-7c9e6b251c78 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:57.190302 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2a1a08bd-79b9-4823-8df1-e2b4a3979e6a tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:57.190977 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2a1a08bd-79b9-4823-8df1-e2b4a3979e6a tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:57.191972 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2a1a08bd-79b9-4823-8df1-e2b4a3979e6a tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:57.194462 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2a1a08bd-79b9-4823-8df1-e2b4a3979e6a tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:57.432181 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-2a1a08bd-79b9-4823-8df1-e2b4a3979e6a tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b91d4485efb4a689a892233333959ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895dbe17859e43a18bb013a98f83a45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:57.447722 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-58caea45-cd87-4aa8-a027-7c9e6b251c78 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:57.459731 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-58caea45-cd87-4aa8-a027-7c9e6b251c78 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.298271 May 10 03:19:57.472109 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-2a1a08bd-79b9-4823-8df1-e2b4a3979e6a tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064" status: 200 len: 1314 microversion: 2.1 time: 0.313517 May 10 03:19:57.476585 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 92/177] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:57 2022] GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:57.484300 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 86/178] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:57 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:57.800512 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-0b186b1c-1064-4b64-8736-dac032f85491 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:57.801137 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-0b186b1c-1064-4b64-8736-dac032f85491 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:57.807679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0b186b1c-1064-4b64-8736-dac032f85491 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:57.808171 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0b186b1c-1064-4b64-8736-dac032f85491 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:57.808931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0b186b1c-1064-4b64-8736-dac032f85491 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:57.809424 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0b186b1c-1064-4b64-8736-dac032f85491 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:57.949085 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-0b186b1c-1064-4b64-8736-dac032f85491 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:57.956747 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-0b186b1c-1064-4b64-8736-dac032f85491 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1365 microversion: 2.1 time: 0.159857 May 10 03:19:57.957740 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 93/179] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:57 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:58.477341 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-9118c498-f2eb-404a-ae59-f433759e9dbf tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:58.479052 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-9118c498-f2eb-404a-ae59-f433759e9dbf tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:58.487007 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9118c498-f2eb-404a-ae59-f433759e9dbf tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:58.487587 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9118c498-f2eb-404a-ae59-f433759e9dbf tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:58.489100 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9118c498-f2eb-404a-ae59-f433759e9dbf tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:58.489696 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9118c498-f2eb-404a-ae59-f433759e9dbf tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:58.492275 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-db7d8ddc-a6a3-41da-bffd-7e9935d64088 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:58.493729 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-db7d8ddc-a6a3-41da-bffd-7e9935d64088 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:58.502577 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-db7d8ddc-a6a3-41da-bffd-7e9935d64088 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:58.503374 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-db7d8ddc-a6a3-41da-bffd-7e9935d64088 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:58.504430 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-db7d8ddc-a6a3-41da-bffd-7e9935d64088 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:58.505285 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-db7d8ddc-a6a3-41da-bffd-7e9935d64088 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:58.745861 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-db7d8ddc-a6a3-41da-bffd-7e9935d64088 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b91d4485efb4a689a892233333959ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895dbe17859e43a18bb013a98f83a45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:58.759091 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-db7d8ddc-a6a3-41da-bffd-7e9935d64088 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064" status: 200 len: 1314 microversion: 2.1 time: 0.270678 May 10 03:19:58.759730 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 94/180] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:58 2022] GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:19:58.761973 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-9118c498-f2eb-404a-ae59-f433759e9dbf tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:58.771198 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-9118c498-f2eb-404a-ae59-f433759e9dbf tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.298221 May 10 03:19:58.776181 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 87/181] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:58 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:58.973468 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-1badcc01-5042-4b2c-9d80-a718ff85699b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:58.974524 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-1badcc01-5042-4b2c-9d80-a718ff85699b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:58.981903 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1badcc01-5042-4b2c-9d80-a718ff85699b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:58.982607 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1badcc01-5042-4b2c-9d80-a718ff85699b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:58.983752 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1badcc01-5042-4b2c-9d80-a718ff85699b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:58.984271 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1badcc01-5042-4b2c-9d80-a718ff85699b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:59.201126 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-1badcc01-5042-4b2c-9d80-a718ff85699b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:19:59.209008 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-1badcc01-5042-4b2c-9d80-a718ff85699b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1555 microversion: 2.1 time: 0.239536 May 10 03:19:59.209944 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 95/182] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:58 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1555 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:19:59.219699 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-2ac97fb9-84a6-4860-b2dc-5abe77582372 tempest-VolumesGetTestJSON-633585037 tempest-VolumesGetTestJSON-633585037-project] Action: 'create', calling method: .version_select at 0x7f6a5d513ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1463799134", "metadata": {"Type": "work"}}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:19:59.226651 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a8d8a8c2-046c-4746-8a4a-ff3fcc4efe4b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:59.227314 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-a8d8a8c2-046c-4746-8a4a-ff3fcc4efe4b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:59.233244 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a8d8a8c2-046c-4746-8a4a-ff3fcc4efe4b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:59.233770 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a8d8a8c2-046c-4746-8a4a-ff3fcc4efe4b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:59.234423 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a8d8a8c2-046c-4746-8a4a-ff3fcc4efe4b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:59.234848 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a8d8a8c2-046c-4746-8a4a-ff3fcc4efe4b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:59.347513 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-a8d8a8c2-046c-4746-8a4a-ff3fcc4efe4b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124448 May 10 03:19:59.348706 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 96/183] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 10 03:19:59 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:19:59.779325 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-92ff4131-b079-4da6-8ed0-37f632b18e86 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:19:59.779325 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-92ff4131-b079-4da6-8ed0-37f632b18e86 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:19:59.794103 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-92ff4131-b079-4da6-8ed0-37f632b18e86 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:59.794559 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-92ff4131-b079-4da6-8ed0-37f632b18e86 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:19:59.795519 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-92ff4131-b079-4da6-8ed0-37f632b18e86 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:19:59.795950 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-92ff4131-b079-4da6-8ed0-37f632b18e86 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:00.001768 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-92ff4131-b079-4da6-8ed0-37f632b18e86 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b91d4485efb4a689a892233333959ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895dbe17859e43a18bb013a98f83a45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:00.023789 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-92ff4131-b079-4da6-8ed0-37f632b18e86 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064" status: 200 len: 1314 microversion: 2.1 time: 0.252371 May 10 03:20:00.024739 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 97/184] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:19:59 2022] GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:00.044241 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-0dd6ec27-64d6-41bb-87f7-8840147aa559 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:00.048911 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-0dd6ec27-64d6-41bb-87f7-8840147aa559 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:00.054552 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0dd6ec27-64d6-41bb-87f7-8840147aa559 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:00.055263 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0dd6ec27-64d6-41bb-87f7-8840147aa559 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:00.056391 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0dd6ec27-64d6-41bb-87f7-8840147aa559 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:00.057007 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0dd6ec27-64d6-41bb-87f7-8840147aa559 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:00.091766 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-2ac97fb9-84a6-4860-b2dc-5abe77582372 tempest-VolumesGetTestJSON-633585037 tempest-VolumesGetTestJSON-633585037-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.993001 May 10 03:20:00.093077 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 88/185] 10.222.0.65 () {60 vars in 1155 bytes} [Tue May 10 03:19:59 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 995 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 10 03:20:00.104635 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-285d5283-5df2-4e1b-afc6-9c0e4ead8b31 tempest-VolumesGetTestJSON-633585037 tempest-VolumesGetTestJSON-633585037-project] Calling method '.version_select at 0x7f6a5d50c5e0>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:00.172430 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-285d5283-5df2-4e1b-afc6-9c0e4ead8b31 tempest-VolumesGetTestJSON-633585037 tempest-VolumesGetTestJSON-633585037-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d75b3f87-c50e-4f5d-9bc0-797a2ec009cd" status: 200 len: 353 microversion: 2.1 time: 0.072027 May 10 03:20:00.172998 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 89/186] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 03:20:00 2022] GET /compute/v2.1/os-volumes/d75b3f87-c50e-4f5d-9bc0-797a2ec009cd => generated 353 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:20:00.309344 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-0dd6ec27-64d6-41bb-87f7-8840147aa559 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:00.316671 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-0dd6ec27-64d6-41bb-87f7-8840147aa559 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.290966 May 10 03:20:00.317236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 98/187] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:00 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:00.675355 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-8d0a7a8a-6585-4615-b9eb-86c7a5d5bb16 req-2e876042-8d6f-4eda-9da0-d43b28962df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a275173c-51a6-4cc6-aef2-b30bcee8b67b", "tag": "3675090a-d6b4-4972-9846-20ea88eb78e8"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:00.691837 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-8d0a7a8a-6585-4615-b9eb-86c7a5d5bb16 req-2e876042-8d6f-4eda-9da0-d43b28962df4 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:00.694316 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-8d0a7a8a-6585-4615-b9eb-86c7a5d5bb16 req-2e876042-8d6f-4eda-9da0-d43b28962df4 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:00.717719 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-8d0a7a8a-6585-4615-b9eb-86c7a5d5bb16 req-2e876042-8d6f-4eda-9da0-d43b28962df4 service nova] Creating event network-changed:3675090a-d6b4-4972-9846-20ea88eb78e8 for instance a275173c-51a6-4cc6-aef2-b30bcee8b67b on hv-cinder-83009 May 10 03:20:00.731106 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-8d0a7a8a-6585-4615-b9eb-86c7a5d5bb16 req-2e876042-8d6f-4eda-9da0-d43b28962df4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079327 May 10 03:20:00.732381 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 90/188] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:00.746146 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-47daa21e-98db-4b97-a1ca-24963484552c req-a88be6e7-348f-4e92-9c50-ee42c2e73b9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a09699c-5e60-48a3-884c-79e14f39b064", "name": "network-vif-plugged", "status": "completed", "tag": "245e8602-9f45-4d84-af6e-756d98bc51c4"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:00.756896 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-47daa21e-98db-4b97-a1ca-24963484552c req-a88be6e7-348f-4e92-9c50-ee42c2e73b9a service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:00.757463 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-47daa21e-98db-4b97-a1ca-24963484552c req-a88be6e7-348f-4e92-9c50-ee42c2e73b9a service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:00.771849 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-47daa21e-98db-4b97-a1ca-24963484552c req-a88be6e7-348f-4e92-9c50-ee42c2e73b9a service nova] Creating event network-vif-plugged:245e8602-9f45-4d84-af6e-756d98bc51c4 for instance 2a09699c-5e60-48a3-884c-79e14f39b064 on hv-cinder-83009 May 10 03:20:00.777326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-47daa21e-98db-4b97-a1ca-24963484552c req-a88be6e7-348f-4e92-9c50-ee42c2e73b9a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035722 May 10 03:20:00.778106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 99/189] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:20:01.041568 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-ced86058-ba64-4359-8bae-e9a2061992ae tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:01.042275 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-ced86058-ba64-4359-8bae-e9a2061992ae tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:01.050626 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ced86058-ba64-4359-8bae-e9a2061992ae tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:01.051268 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ced86058-ba64-4359-8bae-e9a2061992ae tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:01.052503 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ced86058-ba64-4359-8bae-e9a2061992ae tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:01.052925 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ced86058-ba64-4359-8bae-e9a2061992ae tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:01.185998 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-2d32489c-bc6e-4da1-925c-aef437c79c10 tempest-VolumesGetTestJSON-633585037 tempest-VolumesGetTestJSON-633585037-project] Calling method '.version_select at 0x7f6a5e732700>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:01.219258 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ced86058-ba64-4359-8bae-e9a2061992ae tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b91d4485efb4a689a892233333959ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895dbe17859e43a18bb013a98f83a45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:01.232959 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-ced86058-ba64-4359-8bae-e9a2061992ae tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064" status: 200 len: 1314 microversion: 2.1 time: 0.195316 May 10 03:20:01.233754 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 91/190] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:01 2022] GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:01.262631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-2d32489c-bc6e-4da1-925c-aef437c79c10 tempest-VolumesGetTestJSON-633585037 tempest-VolumesGetTestJSON-633585037-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d75b3f87-c50e-4f5d-9bc0-797a2ec009cd" status: 200 len: 354 microversion: 2.1 time: 0.081222 May 10 03:20:01.270251 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 100/191] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 03:20:01 2022] GET /compute/v2.1/os-volumes/d75b3f87-c50e-4f5d-9bc0-797a2ec009cd => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:20:01.275759 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-b1a83f0c-7bb3-4ead-a064-bf687990faf6 tempest-VolumesGetTestJSON-633585037 tempest-VolumesGetTestJSON-633585037-project] Calling method '.version_select at 0x7f6a5d4c1b80>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:01.328317 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-b1a83f0c-7bb3-4ead-a064-bf687990faf6 tempest-VolumesGetTestJSON-633585037 tempest-VolumesGetTestJSON-633585037-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d75b3f87-c50e-4f5d-9bc0-797a2ec009cd" status: 200 len: 354 microversion: 2.1 time: 0.055919 May 10 03:20:01.328317 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 92/192] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 03:20:01 2022] GET /compute/v2.1/os-volumes/d75b3f87-c50e-4f5d-9bc0-797a2ec009cd => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:20:01.337106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-f18693d0-d1fe-47a5-b9e4-53d9b1879ede tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:01.338215 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-f18693d0-d1fe-47a5-b9e4-53d9b1879ede tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:01.348092 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-ff6954c9-572a-47cc-905d-3168a22b6da3 tempest-VolumesGetTestJSON-633585037 tempest-VolumesGetTestJSON-633585037-project] Calling method '.version_select at 0x7f6a5d517820>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:01.359552 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f18693d0-d1fe-47a5-b9e4-53d9b1879ede tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:01.360667 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f18693d0-d1fe-47a5-b9e4-53d9b1879ede tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:01.361744 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f18693d0-d1fe-47a5-b9e4-53d9b1879ede tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:01.363282 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f18693d0-d1fe-47a5-b9e4-53d9b1879ede tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:01.514227 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-f18693d0-d1fe-47a5-b9e4-53d9b1879ede tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:01.524150 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-f18693d0-d1fe-47a5-b9e4-53d9b1879ede tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.194239 May 10 03:20:01.525243 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 101/193] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:01 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:01.619062 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-ff6954c9-572a-47cc-905d-3168a22b6da3 tempest-VolumesGetTestJSON-633585037 tempest-VolumesGetTestJSON-633585037-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/d75b3f87-c50e-4f5d-9bc0-797a2ec009cd" status: 202 len: 0 microversion: 2.1 time: 0.277042 May 10 03:20:01.619729 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 93/194] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 10 03:20:01 2022] DELETE /compute/v2.1/os-volumes/d75b3f87-c50e-4f5d-9bc0-797a2ec009cd => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:20:01.627595 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-da6fd49c-ca82-48d8-9476-f2e5f7c397a2 tempest-VolumesGetTestJSON-633585037 tempest-VolumesGetTestJSON-633585037-project] Calling method '.version_select at 0x7f6a5ddd7310>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:01.695485 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-da6fd49c-ca82-48d8-9476-f2e5f7c397a2 tempest-VolumesGetTestJSON-633585037 tempest-VolumesGetTestJSON-633585037-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d75b3f87-c50e-4f5d-9bc0-797a2ec009cd" status: 200 len: 353 microversion: 2.1 time: 0.070531 May 10 03:20:01.696333 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 102/195] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 03:20:01 2022] GET /compute/v2.1/os-volumes/d75b3f87-c50e-4f5d-9bc0-797a2ec009cd => generated 353 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:02.251994 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-5a794f68-7c97-4043-90ea-9c98d23ec6be tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:02.252777 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-5a794f68-7c97-4043-90ea-9c98d23ec6be tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:02.261643 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5a794f68-7c97-4043-90ea-9c98d23ec6be tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:02.264483 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5a794f68-7c97-4043-90ea-9c98d23ec6be tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:02.264483 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5a794f68-7c97-4043-90ea-9c98d23ec6be tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:02.264483 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5a794f68-7c97-4043-90ea-9c98d23ec6be tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:02.396501 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5a794f68-7c97-4043-90ea-9c98d23ec6be tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b91d4485efb4a689a892233333959ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895dbe17859e43a18bb013a98f83a45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:02.404592 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-5a794f68-7c97-4043-90ea-9c98d23ec6be tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064" status: 200 len: 1314 microversion: 2.1 time: 0.157579 May 10 03:20:02.405249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 94/196] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:02 2022] GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:02.549082 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-f7c08218-8648-4eb6-95c4-dea591d4b872 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:02.549750 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-f7c08218-8648-4eb6-95c4-dea591d4b872 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:02.556564 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f7c08218-8648-4eb6-95c4-dea591d4b872 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:02.557135 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f7c08218-8648-4eb6-95c4-dea591d4b872 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:02.557980 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f7c08218-8648-4eb6-95c4-dea591d4b872 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:02.558426 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f7c08218-8648-4eb6-95c4-dea591d4b872 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:02.688098 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-f7c08218-8648-4eb6-95c4-dea591d4b872 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:02.696065 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-f7c08218-8648-4eb6-95c4-dea591d4b872 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.151011 May 10 03:20:02.698849 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 103/197] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:02 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:02.708075 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-9b08d608-f931-4688-b848-ff3a57cfad36 tempest-VolumesGetTestJSON-633585037 tempest-VolumesGetTestJSON-633585037-project] Calling method '.version_select at 0x7f6a5d4c1700>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:02.734947 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-9b08d608-f931-4688-b848-ff3a57cfad36 tempest-VolumesGetTestJSON-633585037 tempest-VolumesGetTestJSON-633585037-project] HTTP exception thrown: Volume d75b3f87-c50e-4f5d-9bc0-797a2ec009cd could not be found. May 10 03:20:02.737130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-9b08d608-f931-4688-b848-ff3a57cfad36 tempest-VolumesGetTestJSON-633585037 tempest-VolumesGetTestJSON-633585037-project] Request method failure captured: May 10 03:20:02.737130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: GET /compute/v2.1/os-volumes/d75b3f87-c50e-4f5d-9bc0-797a2ec009cd HTTP/1.1 May 10 03:20:02.737130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:20:02.737130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:20:02.737130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:20:02.737130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:20:02.737130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:20:02.737130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:20:02.737130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:20:02.737130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:20:02.737130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiednelSuDpPp_kXSKPGkReOb2P7_V76vpG-iKxmTVqlfb0RM-Q8M9CxQYhx5b5KHxj1IRLtQzPsq6S99vCLnZ-mEKYsQwV0rQC4EhRQqx38ulXTAB2fa4YMtOv-ocybhSIAI7ibero9CHKBfaeYnNfOJK3zlCvbKxDACKwNl0QQ2YrIA May 10 03:20:02.737130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:20:02.737130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:20:02.737130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:20:02.737130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:20:02.737130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:20:02.737130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:20:02.737130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: 635aa0651e7147e988933e9ad3503b9d May 10 03:20:02.737130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-VolumesGetTestJSON-633585037 May 10 03:20:02.737130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:20:02.737130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:20:02.738583 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_635aa0651e7147e988933e9ad3503b9d", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/635aa0651e7147e988933e9ad3503b9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/635aa0651e7147e988933e9ad3503b9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/635aa0651e7147e988933e9ad3503b9d"}]}] May 10 03:20:02.738583 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-VolumesGetTestJSON-633585037 May 10 03:20:02.738583 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: 635aa0651e7147e988933e9ad3503b9d May 10 03:20:02.738583 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-VolumesGetTestJSON-633585037 May 10 03:20:02.738583 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-VolumesGetTestJSON-633585037-project May 10 03:20:02.738583 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:20:02.738583 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:20:02.738583 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: 93aa7b88ac3c475691a2bac55ea5c843 May 10 03:20:02.738583 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-VolumesGetTestJSON-633585037-project May 10 03:20:02.738583 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: May 10 03:20:02.738583 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Volume d75b3f87-c50e-4f5d-9bc0-797a2ec009cd could not be found. May 10 03:20:02.738583 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'id': 'd75b3f87-c50e-4f5d-9bc0-797a2ec009cd'} May 10 03:20:02.738583 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:20:02.739472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:02.739472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:20:02.739472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:20:02.739472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 03:20:02.739472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 03:20:02.739472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 03:20:02.739472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 03:20:02.739472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 03:20:02.739472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 03:20:02.739472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 03:20:02.739472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 03:20:02.739472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:20:02.739472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:20:02.739472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:20:02.739472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:20:02.739472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d75b3f87-c50e-4f5d-9bc0-797a2ec009cd could not be found. (HTTP 404) (Request-ID: req-a3baad00-5f32-4c93-8c54-28631bcaa962) May 10 03:20:02.739472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:20:02.739472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:20:02.739472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:20:02.740755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:02.740755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 03:20:02.740755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 03:20:02.740755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 03:20:02.740755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 03:20:02.740755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 03:20:02.740755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 03:20:02.740755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 03:20:02.740755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 03:20:02.740755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:20:02.740755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:20:02.740755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 03:20:02.740755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 03:20:02.740755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 03:20:02.740755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 03:20:02.740755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 03:20:02.740755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 03:20:02.740755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 03:20:02.740755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 03:20:02.742653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:20:02.742653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:20:02.742653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:20:02.742653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:20:02.742653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d75b3f87-c50e-4f5d-9bc0-797a2ec009cd could not be found. May 10 03:20:02.742653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:20:02.742653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:20:02.742653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:20:02.742653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:02.742653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:20:02.742653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:20:02.742653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:20:02.742653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:20:02.742653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 03:20:02.742653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 03:20:02.742653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:20:02.742653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:20:02.742653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 03:20:02.742653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:20:02.744128 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d75b3f87-c50e-4f5d-9bc0-797a2ec009cd could not be found. May 10 03:20:02.744128 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:20:02.744128 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:20:02.744128 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:20:02.744128 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:02.744128 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:20:02.744128 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:20:02.744128 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:20:02.744128 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:20:02.744128 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d75b3f87-c50e-4f5d-9bc0-797a2ec009cd could not be found. May 10 03:20:02.744128 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:20:02.744128 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-9b08d608-f931-4688-b848-ff3a57cfad36 tempest-VolumesGetTestJSON-633585037 tempest-VolumesGetTestJSON-633585037-project] Returning 404 to user: Volume d75b3f87-c50e-4f5d-9bc0-797a2ec009cd could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:20:02.744128 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-9b08d608-f931-4688-b848-ff3a57cfad36 tempest-VolumesGetTestJSON-633585037 tempest-VolumesGetTestJSON-633585037-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d75b3f87-c50e-4f5d-9bc0-797a2ec009cd" status: 404 len: 109 microversion: 2.1 time: 0.038030 May 10 03:20:02.746047 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 95/198] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 03:20:02 2022] GET /compute/v2.1/os-volumes/d75b3f87-c50e-4f5d-9bc0-797a2ec009cd => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:20:03.421551 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-8ff12db9-717c-4014-89ae-8ccc9355c1d1 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:03.422087 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8ff12db9-717c-4014-89ae-8ccc9355c1d1 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:03.427960 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8ff12db9-717c-4014-89ae-8ccc9355c1d1 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:03.428438 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8ff12db9-717c-4014-89ae-8ccc9355c1d1 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:03.429247 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8ff12db9-717c-4014-89ae-8ccc9355c1d1 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:03.429684 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8ff12db9-717c-4014-89ae-8ccc9355c1d1 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:03.608269 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8ff12db9-717c-4014-89ae-8ccc9355c1d1 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b91d4485efb4a689a892233333959ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895dbe17859e43a18bb013a98f83a45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:03.620158 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-8ff12db9-717c-4014-89ae-8ccc9355c1d1 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064" status: 200 len: 1464 microversion: 2.1 time: 0.199136 May 10 03:20:03.621186 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 104/199] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:03 2022] GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 => generated 1464 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:03.661371 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-7e40609f-1979-4d9c-b263-93cdc9324926 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:03.661945 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-7e40609f-1979-4d9c-b263-93cdc9324926 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:03.669563 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7e40609f-1979-4d9c-b263-93cdc9324926 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:03.670094 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7e40609f-1979-4d9c-b263-93cdc9324926 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:03.670866 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7e40609f-1979-4d9c-b263-93cdc9324926 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:03.671328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7e40609f-1979-4d9c-b263-93cdc9324926 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:03.696173 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-7e40609f-1979-4d9c-b263-93cdc9324926 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Going to try to terminate instance {{(pid=117400) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:20:03.713920 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-47bb11e0-c20a-446b-a5c5-e94c062e6fd5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:03.714451 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-47bb11e0-c20a-446b-a5c5-e94c062e6fd5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:03.720433 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-47bb11e0-c20a-446b-a5c5-e94c062e6fd5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:03.721054 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-47bb11e0-c20a-446b-a5c5-e94c062e6fd5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:03.721907 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-47bb11e0-c20a-446b-a5c5-e94c062e6fd5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:03.723732 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-47bb11e0-c20a-446b-a5c5-e94c062e6fd5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:03.895185 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-47bb11e0-c20a-446b-a5c5-e94c062e6fd5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:03.905164 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-47bb11e0-c20a-446b-a5c5-e94c062e6fd5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.193389 May 10 03:20:03.905164 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 105/200] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:03 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:04.063110 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-7e40609f-1979-4d9c-b263-93cdc9324926 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064" status: 204 len: 0 microversion: 2.1 time: 0.405280 May 10 03:20:04.063907 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 96/201] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:20:03 2022] DELETE /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:20:04.072149 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-d68e9021-856d-4793-be45-069166eeb14c tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:04.072756 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-d68e9021-856d-4793-be45-069166eeb14c tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:04.080098 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d68e9021-856d-4793-be45-069166eeb14c tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:04.080562 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d68e9021-856d-4793-be45-069166eeb14c tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:04.081784 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d68e9021-856d-4793-be45-069166eeb14c tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:04.082228 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d68e9021-856d-4793-be45-069166eeb14c tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:04.215398 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-d68e9021-856d-4793-be45-069166eeb14c tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b91d4485efb4a689a892233333959ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895dbe17859e43a18bb013a98f83a45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:04.222945 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-d68e9021-856d-4793-be45-069166eeb14c tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064" status: 200 len: 1470 microversion: 2.1 time: 0.154762 May 10 03:20:04.223537 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 106/202] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:04 2022] GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:04.920098 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a39b400b-f94b-4e2a-8286-55782484598c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:04.920794 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-a39b400b-f94b-4e2a-8286-55782484598c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:04.929802 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a39b400b-f94b-4e2a-8286-55782484598c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:04.931402 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a39b400b-f94b-4e2a-8286-55782484598c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:04.932523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a39b400b-f94b-4e2a-8286-55782484598c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:04.933297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a39b400b-f94b-4e2a-8286-55782484598c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:05.080135 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-a39b400b-f94b-4e2a-8286-55782484598c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:05.088592 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-a39b400b-f94b-4e2a-8286-55782484598c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.172686 May 10 03:20:05.089252 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 97/203] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:04 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:05.240710 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-7aa339a4-317e-457b-b203-54310ebfeb64 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:05.241984 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-7aa339a4-317e-457b-b203-54310ebfeb64 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:05.247821 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7aa339a4-317e-457b-b203-54310ebfeb64 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:05.248304 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7aa339a4-317e-457b-b203-54310ebfeb64 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:05.249069 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7aa339a4-317e-457b-b203-54310ebfeb64 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:05.249503 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7aa339a4-317e-457b-b203-54310ebfeb64 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:05.382261 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-7aa339a4-317e-457b-b203-54310ebfeb64 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b91d4485efb4a689a892233333959ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895dbe17859e43a18bb013a98f83a45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:05.389733 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-7aa339a4-317e-457b-b203-54310ebfeb64 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064" status: 200 len: 1470 microversion: 2.1 time: 0.152808 May 10 03:20:05.390292 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 107/204] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:05 2022] GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:06.105556 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-fb6f96f3-c775-45a2-960e-cbff0a927179 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:06.106839 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-fb6f96f3-c775-45a2-960e-cbff0a927179 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:06.113334 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fb6f96f3-c775-45a2-960e-cbff0a927179 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:06.113990 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fb6f96f3-c775-45a2-960e-cbff0a927179 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:06.115013 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fb6f96f3-c775-45a2-960e-cbff0a927179 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:06.115676 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fb6f96f3-c775-45a2-960e-cbff0a927179 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:06.324582 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-fb6f96f3-c775-45a2-960e-cbff0a927179 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:06.332093 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-fb6f96f3-c775-45a2-960e-cbff0a927179 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.230538 May 10 03:20:06.332851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 98/205] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:06 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:06.406697 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c4dc4c54-0013-4498-9921-2afbae2960b6 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:06.407306 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-c4dc4c54-0013-4498-9921-2afbae2960b6 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:06.416130 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c4dc4c54-0013-4498-9921-2afbae2960b6 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:06.416585 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c4dc4c54-0013-4498-9921-2afbae2960b6 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:06.417444 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c4dc4c54-0013-4498-9921-2afbae2960b6 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:06.417887 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c4dc4c54-0013-4498-9921-2afbae2960b6 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:06.555101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-c4dc4c54-0013-4498-9921-2afbae2960b6 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b91d4485efb4a689a892233333959ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895dbe17859e43a18bb013a98f83a45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:06.562849 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-c4dc4c54-0013-4498-9921-2afbae2960b6 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064" status: 200 len: 1470 microversion: 2.1 time: 0.160010 May 10 03:20:06.563423 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 108/206] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:06 2022] GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:06.749507 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-790bbb5c-3d92-48c5-9681-7c0e6d5669b8 req-b549e94d-13db-47cb-b456-1d2492a4b6e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a09699c-5e60-48a3-884c-79e14f39b064", "name": "network-vif-deleted", "tag": "245e8602-9f45-4d84-af6e-756d98bc51c4"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:06.777197 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-790bbb5c-3d92-48c5-9681-7c0e6d5669b8 req-b549e94d-13db-47cb-b456-1d2492a4b6e4 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:06.777618 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-790bbb5c-3d92-48c5-9681-7c0e6d5669b8 req-b549e94d-13db-47cb-b456-1d2492a4b6e4 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:06.791136 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-790bbb5c-3d92-48c5-9681-7c0e6d5669b8 req-b549e94d-13db-47cb-b456-1d2492a4b6e4 service nova] Creating event network-vif-deleted:245e8602-9f45-4d84-af6e-756d98bc51c4 for instance 2a09699c-5e60-48a3-884c-79e14f39b064 on hv-cinder-83009 May 10 03:20:06.796903 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-790bbb5c-3d92-48c5-9681-7c0e6d5669b8 req-b549e94d-13db-47cb-b456-1d2492a4b6e4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050940 May 10 03:20:06.797501 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 99/207] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:07.349304 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-de2744e1-d8ba-41a9-b307-4ddb6e68f6a9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:07.349873 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-de2744e1-d8ba-41a9-b307-4ddb6e68f6a9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:07.355764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-de2744e1-d8ba-41a9-b307-4ddb6e68f6a9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:07.356247 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-de2744e1-d8ba-41a9-b307-4ddb6e68f6a9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:07.357004 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-de2744e1-d8ba-41a9-b307-4ddb6e68f6a9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:07.357438 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-de2744e1-d8ba-41a9-b307-4ddb6e68f6a9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:07.495766 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-de2744e1-d8ba-41a9-b307-4ddb6e68f6a9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:07.503467 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-de2744e1-d8ba-41a9-b307-4ddb6e68f6a9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.158075 May 10 03:20:07.504186 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 109/208] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:07 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:07.580745 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-7859951f-f30a-434b-90b2-04e8d29534a8 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:07.581566 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-7859951f-f30a-434b-90b2-04e8d29534a8 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:07.588390 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7859951f-f30a-434b-90b2-04e8d29534a8 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:07.588841 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7859951f-f30a-434b-90b2-04e8d29534a8 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:07.589673 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7859951f-f30a-434b-90b2-04e8d29534a8 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:07.590107 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7859951f-f30a-434b-90b2-04e8d29534a8 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:07.620076 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7859951f-f30a-434b-90b2-04e8d29534a8 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:07.620468 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7859951f-f30a-434b-90b2-04e8d29534a8 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:07.620917 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.objects.instance [None req-7859951f-f30a-434b-90b2-04e8d29534a8 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lazy-loading 'fault' on Instance uuid 2a09699c-5e60-48a3-884c-79e14f39b064 {{(pid=117400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:20:07.669047 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-7859951f-f30a-434b-90b2-04e8d29534a8 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b91d4485efb4a689a892233333959ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895dbe17859e43a18bb013a98f83a45e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:07.676586 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-7859951f-f30a-434b-90b2-04e8d29534a8 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064" status: 200 len: 1304 microversion: 2.1 time: 0.100554 May 10 03:20:07.685963 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 100/209] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:07 2022] GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:08.520125 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-3f566908-0866-4669-b215-a54d28a75003 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:08.520867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-3f566908-0866-4669-b215-a54d28a75003 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:08.527530 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3f566908-0866-4669-b215-a54d28a75003 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:08.527985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3f566908-0866-4669-b215-a54d28a75003 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:08.528792 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3f566908-0866-4669-b215-a54d28a75003 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:08.529230 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3f566908-0866-4669-b215-a54d28a75003 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:08.660438 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-3f566908-0866-4669-b215-a54d28a75003 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:08.668928 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-3f566908-0866-4669-b215-a54d28a75003 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.152700 May 10 03:20:08.669438 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 110/210] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:08 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:08.694002 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-f08ea8d5-b36f-4a59-8bfc-57e9836c8f79 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:08.694651 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-f08ea8d5-b36f-4a59-8bfc-57e9836c8f79 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] [instance: 2a09699c-5e60-48a3-884c-79e14f39b064] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:08.700631 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f08ea8d5-b36f-4a59-8bfc-57e9836c8f79 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:08.703352 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f08ea8d5-b36f-4a59-8bfc-57e9836c8f79 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:08.703352 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f08ea8d5-b36f-4a59-8bfc-57e9836c8f79 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:08.703352 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f08ea8d5-b36f-4a59-8bfc-57e9836c8f79 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:08.718918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-f08ea8d5-b36f-4a59-8bfc-57e9836c8f79 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] HTTP exception thrown: Instance 2a09699c-5e60-48a3-884c-79e14f39b064 could not be found. May 10 03:20:08.720591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-f08ea8d5-b36f-4a59-8bfc-57e9836c8f79 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Request method failure captured: May 10 03:20:08.720591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 HTTP/1.1 May 10 03:20:08.720591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:20:08.720591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:20:08.720591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:20:08.720591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:20:08.720591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:20:08.720591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:20:08.720591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:20:08.720591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:20:08.720591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiednNzmOcpZf3fmwbT178xBEDTwKt6IVjJwOQwJtETNFCrh1sLQW9ygevAM5fEcx_4qsxDwHDCc_axuTePLhXKFlB8S_U2VKm4Pzb3VmQLj1ghFCBO2Z_aGnEOEN9fSUqrD_BDSIQa0rV48Iv_KLAnYjrrDC_-2ZyA0kyusN9D74gOIg May 10 03:20:08.720591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:20:08.720591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:20:08.720591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:20:08.720591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:20:08.720591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:20:08.720591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:20:08.720591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: 895dbe17859e43a18bb013a98f83a45e May 10 03:20:08.720591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-VolumesNegativeTest-1965192278 May 10 03:20:08.720591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:20:08.720591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:20:08.722036 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_895dbe17859e43a18bb013a98f83a45e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/895dbe17859e43a18bb013a98f83a45e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/895dbe17859e43a18bb013a98f83a45e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/895dbe17859e43a18bb013a98f83a45e"}]}] May 10 03:20:08.722036 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-VolumesNegativeTest-1965192278 May 10 03:20:08.722036 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: 895dbe17859e43a18bb013a98f83a45e May 10 03:20:08.722036 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-VolumesNegativeTest-1965192278 May 10 03:20:08.722036 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-VolumesNegativeTest-1965192278-project May 10 03:20:08.722036 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:20:08.722036 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:20:08.722036 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: 7b91d4485efb4a689a892233333959ba May 10 03:20:08.722036 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-VolumesNegativeTest-1965192278-project May 10 03:20:08.722036 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:20:08.722036 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Instance 2a09699c-5e60-48a3-884c-79e14f39b064 could not be found. May 10 03:20:08.722036 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'id': '2a09699c-5e60-48a3-884c-79e14f39b064'} May 10 03:20:08.722935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:20:08.722935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:08.722935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:20:08.722935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:20:08.722935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:20:08.722935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:20:08.722935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:20:08.722935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:20:08.722935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:20:08.722935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:20:08.722935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a09699c-5e60-48a3-884c-79e14f39b064 could not be found. May 10 03:20:08.722935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:20:08.722935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:20:08.722935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:20:08.722935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:08.722935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:20:08.722935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:20:08.722935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:20:08.722935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:20:08.722935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:20:08.724313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:20:08.724313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:20:08.724313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:20:08.724313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:20:08.724313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:20:08.724313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:20:08.724313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:20:08.724313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a09699c-5e60-48a3-884c-79e14f39b064 could not be found. May 10 03:20:08.724313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:20:08.724313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:20:08.724313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:20:08.724313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:20:08.724313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:20:08.724313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:20:08.724313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:20:08.724313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:20:08.724313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a09699c-5e60-48a3-884c-79e14f39b064 could not be found. May 10 03:20:08.724313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:20:08.726577 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-f08ea8d5-b36f-4a59-8bfc-57e9836c8f79 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] Returning 404 to user: Instance 2a09699c-5e60-48a3-884c-79e14f39b064 could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:20:08.726577 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-f08ea8d5-b36f-4a59-8bfc-57e9836c8f79 tempest-VolumesNegativeTest-1965192278 tempest-VolumesNegativeTest-1965192278-project] 10.222.0.65 "GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064" status: 404 len: 111 microversion: 2.1 time: 0.031861 May 10 03:20:08.726577 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 101/211] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:08 2022] GET /compute/v2.1/servers/2a09699c-5e60-48a3-884c-79e14f39b064 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:20:09.689550 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-8953bf44-008d-43a0-b9e9-66c11784e467 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:09.690285 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8953bf44-008d-43a0-b9e9-66c11784e467 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:09.696494 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8953bf44-008d-43a0-b9e9-66c11784e467 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:09.699048 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8953bf44-008d-43a0-b9e9-66c11784e467 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:09.699048 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8953bf44-008d-43a0-b9e9-66c11784e467 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:09.699048 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8953bf44-008d-43a0-b9e9-66c11784e467 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:09.839063 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8953bf44-008d-43a0-b9e9-66c11784e467 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:09.846567 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-8953bf44-008d-43a0-b9e9-66c11784e467 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.161239 May 10 03:20:09.847142 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 111/212] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:09 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:10.864733 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a9f0a22d-5b04-4b70-b4c9-461f662a6461 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:10.865455 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-a9f0a22d-5b04-4b70-b4c9-461f662a6461 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:10.872966 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a9f0a22d-5b04-4b70-b4c9-461f662a6461 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:10.873425 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a9f0a22d-5b04-4b70-b4c9-461f662a6461 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:10.874209 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a9f0a22d-5b04-4b70-b4c9-461f662a6461 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:10.874728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a9f0a22d-5b04-4b70-b4c9-461f662a6461 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:11.008460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-a9f0a22d-5b04-4b70-b4c9-461f662a6461 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:11.015802 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-a9f0a22d-5b04-4b70-b4c9-461f662a6461 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.154981 May 10 03:20:11.016407 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 102/213] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:10 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:12.035801 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-2e600eef-5b56-48fc-904a-0311c13393c2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:12.040803 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-2e600eef-5b56-48fc-904a-0311c13393c2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:12.055961 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2e600eef-5b56-48fc-904a-0311c13393c2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:12.058136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2e600eef-5b56-48fc-904a-0311c13393c2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:12.058136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2e600eef-5b56-48fc-904a-0311c13393c2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:12.058136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2e600eef-5b56-48fc-904a-0311c13393c2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:12.215539 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-2e600eef-5b56-48fc-904a-0311c13393c2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:12.223495 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-2e600eef-5b56-48fc-904a-0311c13393c2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.191483 May 10 03:20:12.224228 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 112/214] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:12 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:13.242336 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-622b063f-875b-45b4-a3c7-fc00e6aa7f1b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:13.243304 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-622b063f-875b-45b4-a3c7-fc00e6aa7f1b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:13.254199 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-622b063f-875b-45b4-a3c7-fc00e6aa7f1b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:13.254710 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-622b063f-875b-45b4-a3c7-fc00e6aa7f1b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:13.255491 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-622b063f-875b-45b4-a3c7-fc00e6aa7f1b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:13.261078 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-622b063f-875b-45b4-a3c7-fc00e6aa7f1b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:13.422314 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-622b063f-875b-45b4-a3c7-fc00e6aa7f1b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:13.431968 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-622b063f-875b-45b4-a3c7-fc00e6aa7f1b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.193492 May 10 03:20:13.432558 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 103/215] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:13 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:14.455823 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-7231da4b-6d02-4b17-958d-1a56f0c1edea tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:14.455823 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-7231da4b-6d02-4b17-958d-1a56f0c1edea tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:14.458217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7231da4b-6d02-4b17-958d-1a56f0c1edea tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:14.458669 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7231da4b-6d02-4b17-958d-1a56f0c1edea tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:14.459446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7231da4b-6d02-4b17-958d-1a56f0c1edea tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:14.459910 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7231da4b-6d02-4b17-958d-1a56f0c1edea tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:14.618972 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-7231da4b-6d02-4b17-958d-1a56f0c1edea tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:14.626769 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-7231da4b-6d02-4b17-958d-1a56f0c1edea tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.179504 May 10 03:20:14.627341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 113/216] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:14 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:15.643943 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-5d65a506-e405-4083-aec0-4d3037259888 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:15.644580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-5d65a506-e405-4083-aec0-4d3037259888 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:15.651494 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5d65a506-e405-4083-aec0-4d3037259888 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:15.651944 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5d65a506-e405-4083-aec0-4d3037259888 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:15.652746 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5d65a506-e405-4083-aec0-4d3037259888 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:15.653191 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5d65a506-e405-4083-aec0-4d3037259888 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:15.796801 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5d65a506-e405-4083-aec0-4d3037259888 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:15.807141 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-5d65a506-e405-4083-aec0-4d3037259888 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.167162 May 10 03:20:15.807723 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 104/217] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:15 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:16.824237 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c08009b2-5012-4a05-9fb2-fb59182d657e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:16.824845 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-c08009b2-5012-4a05-9fb2-fb59182d657e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:16.830687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c08009b2-5012-4a05-9fb2-fb59182d657e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:16.831141 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c08009b2-5012-4a05-9fb2-fb59182d657e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:16.831931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c08009b2-5012-4a05-9fb2-fb59182d657e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:16.832463 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c08009b2-5012-4a05-9fb2-fb59182d657e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:16.969128 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-c08009b2-5012-4a05-9fb2-fb59182d657e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:16.972678 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-c08009b2-5012-4a05-9fb2-fb59182d657e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.152257 May 10 03:20:16.973260 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 114/218] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:16 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:17.989722 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-e18cc0c1-51ea-4308-b0a2-0f154a46aeb2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:17.990959 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-e18cc0c1-51ea-4308-b0a2-0f154a46aeb2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:17.997541 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e18cc0c1-51ea-4308-b0a2-0f154a46aeb2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:17.997993 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e18cc0c1-51ea-4308-b0a2-0f154a46aeb2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:17.998768 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e18cc0c1-51ea-4308-b0a2-0f154a46aeb2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:17.999206 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e18cc0c1-51ea-4308-b0a2-0f154a46aeb2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:18.146572 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-e18cc0c1-51ea-4308-b0a2-0f154a46aeb2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:18.154860 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-e18cc0c1-51ea-4308-b0a2-0f154a46aeb2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.168993 May 10 03:20:18.155577 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 105/219] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:17 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:19.172709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-f8e10c95-dcb7-4279-981a-ac4c8f82a005 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:19.173233 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-f8e10c95-dcb7-4279-981a-ac4c8f82a005 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:19.179863 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f8e10c95-dcb7-4279-981a-ac4c8f82a005 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:19.180354 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f8e10c95-dcb7-4279-981a-ac4c8f82a005 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:19.186570 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f8e10c95-dcb7-4279-981a-ac4c8f82a005 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:19.186570 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f8e10c95-dcb7-4279-981a-ac4c8f82a005 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:19.344871 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-f8e10c95-dcb7-4279-981a-ac4c8f82a005 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:19.354234 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-f8e10c95-dcb7-4279-981a-ac4c8f82a005 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.185409 May 10 03:20:19.355583 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 115/220] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:19 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:20.371060 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-061caa00-0fd4-4ce3-ae40-311895fa1183 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:20.372352 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-061caa00-0fd4-4ce3-ae40-311895fa1183 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:20.380991 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-061caa00-0fd4-4ce3-ae40-311895fa1183 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:20.381727 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-061caa00-0fd4-4ce3-ae40-311895fa1183 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:20.382978 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-061caa00-0fd4-4ce3-ae40-311895fa1183 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:20.384222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-061caa00-0fd4-4ce3-ae40-311895fa1183 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:20.726721 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-061caa00-0fd4-4ce3-ae40-311895fa1183 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:20.736504 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-061caa00-0fd4-4ce3-ae40-311895fa1183 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.369136 May 10 03:20:20.738613 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 106/221] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:20 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:21.752963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-95186c0e-d9fd-48ef-982d-a17810c1ffe8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:21.753637 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-95186c0e-d9fd-48ef-982d-a17810c1ffe8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:21.765734 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-95186c0e-d9fd-48ef-982d-a17810c1ffe8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:21.766194 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-95186c0e-d9fd-48ef-982d-a17810c1ffe8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:21.766990 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-95186c0e-d9fd-48ef-982d-a17810c1ffe8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:21.767425 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-95186c0e-d9fd-48ef-982d-a17810c1ffe8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:22.034801 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-95186c0e-d9fd-48ef-982d-a17810c1ffe8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:22.044341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-95186c0e-d9fd-48ef-982d-a17810c1ffe8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.295008 May 10 03:20:22.045145 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 116/222] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:21 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:23.062836 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-8cc33afa-dfc6-45f6-90c2-0bf850314b9c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:23.062836 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-8cc33afa-dfc6-45f6-90c2-0bf850314b9c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:23.068909 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8cc33afa-dfc6-45f6-90c2-0bf850314b9c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:23.069425 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8cc33afa-dfc6-45f6-90c2-0bf850314b9c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:23.070382 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8cc33afa-dfc6-45f6-90c2-0bf850314b9c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:23.070823 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8cc33afa-dfc6-45f6-90c2-0bf850314b9c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:23.284966 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-8cc33afa-dfc6-45f6-90c2-0bf850314b9c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:23.293394 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-8cc33afa-dfc6-45f6-90c2-0bf850314b9c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.236784 May 10 03:20:23.294420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 107/223] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:23 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:24.312142 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a85b292d-3714-4f8f-85ab-693ec9166a4e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:24.313433 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-a85b292d-3714-4f8f-85ab-693ec9166a4e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:24.321138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a85b292d-3714-4f8f-85ab-693ec9166a4e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:24.321766 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a85b292d-3714-4f8f-85ab-693ec9166a4e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:24.322719 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a85b292d-3714-4f8f-85ab-693ec9166a4e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:24.323162 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a85b292d-3714-4f8f-85ab-693ec9166a4e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:24.545534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-a85b292d-3714-4f8f-85ab-693ec9166a4e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:24.560253 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-a85b292d-3714-4f8f-85ab-693ec9166a4e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.249201 May 10 03:20:24.560955 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 117/224] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:24 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:25.577461 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-d93d79af-31e3-47e8-a7c4-d6671d72c4d6 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:25.578105 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-d93d79af-31e3-47e8-a7c4-d6671d72c4d6 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:25.584889 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d93d79af-31e3-47e8-a7c4-d6671d72c4d6 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:25.589396 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d93d79af-31e3-47e8-a7c4-d6671d72c4d6 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:25.589396 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d93d79af-31e3-47e8-a7c4-d6671d72c4d6 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:25.589396 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d93d79af-31e3-47e8-a7c4-d6671d72c4d6 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:25.736835 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-d93d79af-31e3-47e8-a7c4-d6671d72c4d6 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:25.746019 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-d93d79af-31e3-47e8-a7c4-d6671d72c4d6 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.172362 May 10 03:20:25.746837 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 108/225] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:25 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:26.767362 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-8e4c030c-faf7-4f72-a7d2-69992ecf0216 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:26.767970 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8e4c030c-faf7-4f72-a7d2-69992ecf0216 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:26.777164 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8e4c030c-faf7-4f72-a7d2-69992ecf0216 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:26.777547 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8e4c030c-faf7-4f72-a7d2-69992ecf0216 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:26.778448 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8e4c030c-faf7-4f72-a7d2-69992ecf0216 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:26.778882 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8e4c030c-faf7-4f72-a7d2-69992ecf0216 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:26.991636 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8e4c030c-faf7-4f72-a7d2-69992ecf0216 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:27.026285 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-8e4c030c-faf7-4f72-a7d2-69992ecf0216 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.263609 May 10 03:20:27.033836 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 118/226] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:26 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:28.043569 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-5b68da40-c8b0-43ea-be33-8b065b221ddc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:28.044946 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-5b68da40-c8b0-43ea-be33-8b065b221ddc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:28.076375 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5b68da40-c8b0-43ea-be33-8b065b221ddc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:28.076835 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5b68da40-c8b0-43ea-be33-8b065b221ddc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:28.078848 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5b68da40-c8b0-43ea-be33-8b065b221ddc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:28.079291 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5b68da40-c8b0-43ea-be33-8b065b221ddc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:28.373594 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5b68da40-c8b0-43ea-be33-8b065b221ddc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:28.396701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-5b68da40-c8b0-43ea-be33-8b065b221ddc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.357627 May 10 03:20:28.400356 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 109/227] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:28 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:29.424789 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c1a1833b-f8e8-42c6-b525-2c12e9a41716 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:29.425975 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-c1a1833b-f8e8-42c6-b525-2c12e9a41716 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:29.439569 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c1a1833b-f8e8-42c6-b525-2c12e9a41716 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:29.440264 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c1a1833b-f8e8-42c6-b525-2c12e9a41716 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:29.441145 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c1a1833b-f8e8-42c6-b525-2c12e9a41716 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:29.441664 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c1a1833b-f8e8-42c6-b525-2c12e9a41716 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:29.767214 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-c1a1833b-f8e8-42c6-b525-2c12e9a41716 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:29.776266 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-c1a1833b-f8e8-42c6-b525-2c12e9a41716 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.364607 May 10 03:20:29.777542 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 119/228] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:29 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:30.795444 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-1f6b1622-7777-4167-84d4-5686795c6edc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:30.801789 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-1f6b1622-7777-4167-84d4-5686795c6edc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:30.807501 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1f6b1622-7777-4167-84d4-5686795c6edc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:30.814381 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1f6b1622-7777-4167-84d4-5686795c6edc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:30.817332 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1f6b1622-7777-4167-84d4-5686795c6edc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:30.819869 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1f6b1622-7777-4167-84d4-5686795c6edc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:31.243054 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1f6b1622-7777-4167-84d4-5686795c6edc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:31.252212 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-1f6b1622-7777-4167-84d4-5686795c6edc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.461175 May 10 03:20:31.253135 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 110/229] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:30 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:32.270471 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e508afc6-f99b-4d3a-9e02-5ebaf5dbc185 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:32.272401 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-e508afc6-f99b-4d3a-9e02-5ebaf5dbc185 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:32.280580 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e508afc6-f99b-4d3a-9e02-5ebaf5dbc185 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:32.281534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e508afc6-f99b-4d3a-9e02-5ebaf5dbc185 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:32.282573 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e508afc6-f99b-4d3a-9e02-5ebaf5dbc185 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:32.283307 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e508afc6-f99b-4d3a-9e02-5ebaf5dbc185 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:32.718179 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-e508afc6-f99b-4d3a-9e02-5ebaf5dbc185 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:32.726750 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-e508afc6-f99b-4d3a-9e02-5ebaf5dbc185 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.460278 May 10 03:20:32.727679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 120/230] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:32 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:33.701618 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a037595d-2592-4beb-aa5a-030181270c0a tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Action: 'create', calling method: .version_select at 0x7f6a5d517700>, body: {"keypair": {"name": "tempest-TestShelveInstance-1309171344", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9FXnyO8Y+OdMFo96VJyjoKRm3yyPKjJGwrq3DdPaIs85yniLulVYUJbtqpuZzeeKvmPWJwiGbFQaYekzvyNhGFs6wLQ0aGxXUrSnUEZOCn5ads4dy5f+NbBVvhwpTtiw=="}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:33.715503 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-a037595d-2592-4beb-aa5a-030181270c0a tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Getting quotas for project 4524e2de8e8e4dbfa1cb85515dbeb90a. Resources: {'key_pairs'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:20:33.719221 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-a037595d-2592-4beb-aa5a-030181270c0a tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Getting quotas for user a49b27f57e9049518e157d39f6901bd7 and project 4524e2de8e8e4dbfa1cb85515dbeb90a. Resources: {'key_pairs'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:20:33.747301 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-1f0d10ea-52a7-43bf-9960-e991aa3a04ee tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:33.747865 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-1f0d10ea-52a7-43bf-9960-e991aa3a04ee tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:33.753995 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1f0d10ea-52a7-43bf-9960-e991aa3a04ee tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:33.754452 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1f0d10ea-52a7-43bf-9960-e991aa3a04ee tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:33.755213 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1f0d10ea-52a7-43bf-9960-e991aa3a04ee tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:33.755649 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1f0d10ea-52a7-43bf-9960-e991aa3a04ee tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:33.825215 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-a037595d-2592-4beb-aa5a-030181270c0a tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.287744 May 10 03:20:33.825215 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 111/231] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 10 03:20:33 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:20:33.904126 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-1f0d10ea-52a7-43bf-9960-e991aa3a04ee tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:33.911747 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-1f0d10ea-52a7-43bf-9960-e991aa3a04ee tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1521 microversion: 2.1 time: 0.168347 May 10 03:20:33.912344 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 121/232] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:33 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:34.929558 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-91d83813-503c-4883-bd84-ea5a671f1b8a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:34.930161 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-91d83813-503c-4883-bd84-ea5a671f1b8a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:34.936708 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-91d83813-503c-4883-bd84-ea5a671f1b8a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:34.937153 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-91d83813-503c-4883-bd84-ea5a671f1b8a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:34.937910 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-91d83813-503c-4883-bd84-ea5a671f1b8a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:34.938340 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-91d83813-503c-4883-bd84-ea5a671f1b8a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:35.120268 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-91d83813-503c-4883-bd84-ea5a671f1b8a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:35.122949 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-91d83813-503c-4883-bd84-ea5a671f1b8a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1501 microversion: 2.1 time: 0.197766 May 10 03:20:35.123440 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 112/233] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:34 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1501 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:35.142993 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-4a3abe05-75ac-418c-9d87-c82061856960 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:35.143610 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-4a3abe05-75ac-418c-9d87-c82061856960 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:35.150408 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4a3abe05-75ac-418c-9d87-c82061856960 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:35.150915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4a3abe05-75ac-418c-9d87-c82061856960 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:35.151686 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4a3abe05-75ac-418c-9d87-c82061856960 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:35.152245 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4a3abe05-75ac-418c-9d87-c82061856960 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:35.332153 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-4a3abe05-75ac-418c-9d87-c82061856960 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:35.343496 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-4a3abe05-75ac-418c-9d87-c82061856960 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1517 microversion: 2.1 time: 0.204525 May 10 03:20:35.343496 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 122/234] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:35 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1517 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:37.267369 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-71d75dfb-4371-4b46-8234-3ed35690fa13 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:37.269177 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-71d75dfb-4371-4b46-8234-3ed35690fa13 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:37.296712 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-71d75dfb-4371-4b46-8234-3ed35690fa13 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:37.298548 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-71d75dfb-4371-4b46-8234-3ed35690fa13 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:37.300693 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-71d75dfb-4371-4b46-8234-3ed35690fa13 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:37.310242 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-71d75dfb-4371-4b46-8234-3ed35690fa13 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:37.351178 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.objects.instance [None req-71d75dfb-4371-4b46-8234-3ed35690fa13 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lazy-loading 'flavor' on Instance uuid b289186d-a316-4521-92a0-4e13ae9b0083 {{(pid=117400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:20:37.678981 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-71d75dfb-4371-4b46-8234-3ed35690fa13 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "POST /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083/action" status: 200 len: 32 microversion: 2.1 time: 0.422453 May 10 03:20:37.679705 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 113/235] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 03:20:37 2022] POST /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083/action => generated 32 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:20:37.690264 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-74228861-0f0b-47fa-b7b3-51f2176321e4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:37.690864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-74228861-0f0b-47fa-b7b3-51f2176321e4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:37.698823 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-74228861-0f0b-47fa-b7b3-51f2176321e4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:37.699271 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-74228861-0f0b-47fa-b7b3-51f2176321e4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:37.700081 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-74228861-0f0b-47fa-b7b3-51f2176321e4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:37.700664 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-74228861-0f0b-47fa-b7b3-51f2176321e4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:37.851678 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-74228861-0f0b-47fa-b7b3-51f2176321e4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:37.859612 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-74228861-0f0b-47fa-b7b3-51f2176321e4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.173374 May 10 03:20:37.860224 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 123/236] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:37 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:38.409046 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-b8da96fc-e9a4-4472-9a39-6fa48096e65b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:38.409652 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-b8da96fc-e9a4-4472-9a39-6fa48096e65b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:38.416398 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b8da96fc-e9a4-4472-9a39-6fa48096e65b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:38.431637 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b8da96fc-e9a4-4472-9a39-6fa48096e65b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:38.431637 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b8da96fc-e9a4-4472-9a39-6fa48096e65b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:38.431637 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b8da96fc-e9a4-4472-9a39-6fa48096e65b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:38.447501 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-b8da96fc-e9a4-4472-9a39-6fa48096e65b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13/ips" status: 200 len: 144 microversion: 2.1 time: 0.043431 May 10 03:20:38.452776 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 114/237] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 10 03:20:38 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13/ips => generated 144 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:38.875880 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-10a7d254-e96f-41c6-be9e-47c7f7ac13b8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:38.876528 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-10a7d254-e96f-41c6-be9e-47c7f7ac13b8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:38.883297 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-10a7d254-e96f-41c6-be9e-47c7f7ac13b8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:38.883751 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-10a7d254-e96f-41c6-be9e-47c7f7ac13b8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:38.884551 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-10a7d254-e96f-41c6-be9e-47c7f7ac13b8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:38.884987 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-10a7d254-e96f-41c6-be9e-47c7f7ac13b8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:39.017146 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-10a7d254-e96f-41c6-be9e-47c7f7ac13b8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:39.024560 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-10a7d254-e96f-41c6-be9e-47c7f7ac13b8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.152437 May 10 03:20:39.025137 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 124/238] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:38 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:40.042234 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-c5bef50d-6549-4350-a095-6786c86ba8c0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:40.043041 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-c5bef50d-6549-4350-a095-6786c86ba8c0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:40.049638 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c5bef50d-6549-4350-a095-6786c86ba8c0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:40.050092 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c5bef50d-6549-4350-a095-6786c86ba8c0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:40.050865 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c5bef50d-6549-4350-a095-6786c86ba8c0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:40.051301 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c5bef50d-6549-4350-a095-6786c86ba8c0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:40.192036 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-c5bef50d-6549-4350-a095-6786c86ba8c0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:40.200859 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-c5bef50d-6549-4350-a095-6786c86ba8c0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.163118 May 10 03:20:40.201439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 115/239] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:40 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:41.218794 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-57f29c84-02da-47ae-be07-2fc6de0ed1c3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:41.219434 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-57f29c84-02da-47ae-be07-2fc6de0ed1c3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:41.226225 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-57f29c84-02da-47ae-be07-2fc6de0ed1c3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:41.226684 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-57f29c84-02da-47ae-be07-2fc6de0ed1c3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:41.227453 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-57f29c84-02da-47ae-be07-2fc6de0ed1c3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:41.227936 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-57f29c84-02da-47ae-be07-2fc6de0ed1c3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:41.379415 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-57f29c84-02da-47ae-be07-2fc6de0ed1c3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:41.387703 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-57f29c84-02da-47ae-be07-2fc6de0ed1c3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.172993 May 10 03:20:41.388332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 125/240] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:41 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:42.405704 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-3249ce4f-5ae8-4a78-8a7e-76cf1d35b0df tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:42.406969 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-3249ce4f-5ae8-4a78-8a7e-76cf1d35b0df tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:42.418552 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3249ce4f-5ae8-4a78-8a7e-76cf1d35b0df tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:42.419087 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3249ce4f-5ae8-4a78-8a7e-76cf1d35b0df tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:42.420124 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3249ce4f-5ae8-4a78-8a7e-76cf1d35b0df tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:42.420633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3249ce4f-5ae8-4a78-8a7e-76cf1d35b0df tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:42.584762 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-3249ce4f-5ae8-4a78-8a7e-76cf1d35b0df tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:42.595756 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-3249ce4f-5ae8-4a78-8a7e-76cf1d35b0df tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.191064 May 10 03:20:42.597138 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 116/241] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:42 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:42.709667 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e6bc9b59-06d8-4fa0-ba9e-e105f1dc0599 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32a6aa10-0382-49f9-a3f4-0ba3e923c2be"}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:42.711990 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-e6bc9b59-06d8-4fa0-ba9e-e105f1dc0599 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:42.719063 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e6bc9b59-06d8-4fa0-ba9e-e105f1dc0599 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:42.724285 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e6bc9b59-06d8-4fa0-ba9e-e105f1dc0599 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:42.726208 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e6bc9b59-06d8-4fa0-ba9e-e105f1dc0599 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:42.727213 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e6bc9b59-06d8-4fa0-ba9e-e105f1dc0599 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:42.803947 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-2b8ebacc-b46f-47e0-8deb-de2b1c2b23b9 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:42.804485 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-2b8ebacc-b46f-47e0-8deb-de2b1c2b23b9 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:42.814244 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2b8ebacc-b46f-47e0-8deb-de2b1c2b23b9 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:42.814940 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2b8ebacc-b46f-47e0-8deb-de2b1c2b23b9 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:42.815940 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2b8ebacc-b46f-47e0-8deb-de2b1c2b23b9 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:42.816435 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2b8ebacc-b46f-47e0-8deb-de2b1c2b23b9 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:42.843656 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-2b8ebacc-b46f-47e0-8deb-de2b1c2b23b9 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636/ips" status: 200 len: 152 microversion: 2.20 time: 0.044049 May 10 03:20:42.844270 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 117/242] 10.222.0.65 () {60 vars in 1288 bytes} [Tue May 10 03:20:42 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 03:20:43.615164 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-b8ee4e24-7c16-401c-8617-2c7a95876e73 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:43.615879 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-b8ee4e24-7c16-401c-8617-2c7a95876e73 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:43.622605 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b8ee4e24-7c16-401c-8617-2c7a95876e73 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:43.623139 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b8ee4e24-7c16-401c-8617-2c7a95876e73 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:43.624046 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b8ee4e24-7c16-401c-8617-2c7a95876e73 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:43.624642 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b8ee4e24-7c16-401c-8617-2c7a95876e73 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:43.656941 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-e6bc9b59-06d8-4fa0-ba9e-e105f1dc0599 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "POST /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.949934 May 10 03:20:43.658215 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 126/243] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 03:20:42 2022] POST /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13/os-volume_attachments => generated 194 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:43.795309 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-b8ee4e24-7c16-401c-8617-2c7a95876e73 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:43.806846 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-b8ee4e24-7c16-401c-8617-2c7a95876e73 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.197174 May 10 03:20:43.809707 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 118/244] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:43 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:44.824685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-8d50298c-6666-4d38-a1d6-fad53fb09455 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:44.825406 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8d50298c-6666-4d38-a1d6-fad53fb09455 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:44.831409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8d50298c-6666-4d38-a1d6-fad53fb09455 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:44.831859 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8d50298c-6666-4d38-a1d6-fad53fb09455 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:44.832887 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8d50298c-6666-4d38-a1d6-fad53fb09455 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:44.833058 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8d50298c-6666-4d38-a1d6-fad53fb09455 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:44.982207 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8d50298c-6666-4d38-a1d6-fad53fb09455 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:44.989315 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-8d50298c-6666-4d38-a1d6-fad53fb09455 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.169176 May 10 03:20:44.989898 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 127/245] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:44 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:45.689674 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-24ff5b9a-704d-4f20-a36f-da0687a12f80 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:45.690251 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-24ff5b9a-704d-4f20-a36f-da0687a12f80 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:45.696828 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-24ff5b9a-704d-4f20-a36f-da0687a12f80 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:45.697274 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-24ff5b9a-704d-4f20-a36f-da0687a12f80 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:45.698065 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-24ff5b9a-704d-4f20-a36f-da0687a12f80 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:45.698526 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-24ff5b9a-704d-4f20-a36f-da0687a12f80 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:45.721529 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.objects.instance [None req-24ff5b9a-704d-4f20-a36f-da0687a12f80 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lazy-loading 'flavor' on Instance uuid e8796004-8adb-4534-a094-c62dfd2a9636 {{(pid=117400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:20:45.926190 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-09931bf1-505e-4b53-8c56-c36dfcc5c7d7 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:45.933546 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-09931bf1-505e-4b53-8c56-c36dfcc5c7d7 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:45.933986 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-09931bf1-505e-4b53-8c56-c36dfcc5c7d7 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:46.004762 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-09931bf1-505e-4b53-8c56-c36dfcc5c7d7 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Going to try to stop instance {{(pid=117399) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 03:20:46.193410 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-09931bf1-505e-4b53-8c56-c36dfcc5c7d7 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "POST /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13/action" status: 202 len: 0 microversion: 2.1 time: 0.270490 May 10 03:20:46.194626 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 128/246] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 03:20:45 2022] POST /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 03:20:46.203381 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-1a7842ef-b8fd-4ab6-a13f-e10c1bbba1d3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:46.204253 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-1a7842ef-b8fd-4ab6-a13f-e10c1bbba1d3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:46.213257 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1a7842ef-b8fd-4ab6-a13f-e10c1bbba1d3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:46.213717 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1a7842ef-b8fd-4ab6-a13f-e10c1bbba1d3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:46.214626 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1a7842ef-b8fd-4ab6-a13f-e10c1bbba1d3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:46.215070 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1a7842ef-b8fd-4ab6-a13f-e10c1bbba1d3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:46.504792 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-1a7842ef-b8fd-4ab6-a13f-e10c1bbba1d3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:46.513087 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-1a7842ef-b8fd-4ab6-a13f-e10c1bbba1d3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.317267 May 10 03:20:46.513654 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 129/247] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:46 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:46.517963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-5e46c5c8-f83a-42c5-a5bf-4c9a38b650ad tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:46.518563 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-5e46c5c8-f83a-42c5-a5bf-4c9a38b650ad tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:46.524255 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5e46c5c8-f83a-42c5-a5bf-4c9a38b650ad tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:46.524702 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5e46c5c8-f83a-42c5-a5bf-4c9a38b650ad tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:46.525468 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5e46c5c8-f83a-42c5-a5bf-4c9a38b650ad tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:46.525910 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5e46c5c8-f83a-42c5-a5bf-4c9a38b650ad tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:46.672876 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-5e46c5c8-f83a-42c5-a5bf-4c9a38b650ad tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:46.681400 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-5e46c5c8-f83a-42c5-a5bf-4c9a38b650ad tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1722 microversion: 2.1 time: 0.166803 May 10 03:20:46.681955 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 130/248] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:46 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:46.920465 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-24ff5b9a-704d-4f20-a36f-da0687a12f80 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "POST /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636/action" status: 202 len: 0 microversion: 2.20 time: 1.234663 May 10 03:20:46.921213 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 119/249] 10.222.0.65 () {62 vars in 1318 bytes} [Tue May 10 03:20:45 2022] POST /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636/action => generated 0 bytes in 1236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 03:20:46.930928 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e951d4fd-edff-48ff-abfb-f8711364da45 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:46.931551 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-e951d4fd-edff-48ff-abfb-f8711364da45 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:46.938305 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e951d4fd-edff-48ff-abfb-f8711364da45 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:46.938750 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e951d4fd-edff-48ff-abfb-f8711364da45 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:46.939524 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e951d4fd-edff-48ff-abfb-f8711364da45 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:46.939995 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e951d4fd-edff-48ff-abfb-f8711364da45 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:47.079585 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-e951d4fd-edff-48ff-abfb-f8711364da45 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:47.087976 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-e951d4fd-edff-48ff-abfb-f8711364da45 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:47.089719 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-e951d4fd-edff-48ff-abfb-f8711364da45 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:47.090980 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-e951d4fd-edff-48ff-abfb-f8711364da45 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1722 microversion: 2.20 time: 0.164289 May 10 03:20:47.091561 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 131/250] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:20:46 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:47.530112 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-e7e5c451-34d4-4aad-b26c-430213d9fab1 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:47.530927 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-e7e5c451-34d4-4aad-b26c-430213d9fab1 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:47.537703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e7e5c451-34d4-4aad-b26c-430213d9fab1 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:47.538249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e7e5c451-34d4-4aad-b26c-430213d9fab1 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:47.539476 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e7e5c451-34d4-4aad-b26c-430213d9fab1 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:47.539967 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e7e5c451-34d4-4aad-b26c-430213d9fab1 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:47.685491 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-e7e5c451-34d4-4aad-b26c-430213d9fab1 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:47.695460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-e7e5c451-34d4-4aad-b26c-430213d9fab1 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.169505 May 10 03:20:47.703999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-79b2e3ad-5bd2-4bfc-a64c-7ea299f168df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:47.704886 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-79b2e3ad-5bd2-4bfc-a64c-7ea299f168df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:47.706440 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 120/251] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:47 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:47.711951 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-79b2e3ad-5bd2-4bfc-a64c-7ea299f168df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:47.712424 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-79b2e3ad-5bd2-4bfc-a64c-7ea299f168df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:47.713206 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-79b2e3ad-5bd2-4bfc-a64c-7ea299f168df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:47.713647 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-79b2e3ad-5bd2-4bfc-a64c-7ea299f168df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:47.818198 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-929048bf-0664-4cb8-ba64-5240b1a37913 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:47.818781 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-929048bf-0664-4cb8-ba64-5240b1a37913 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:47.826403 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-929048bf-0664-4cb8-ba64-5240b1a37913 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:47.826917 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-929048bf-0664-4cb8-ba64-5240b1a37913 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:47.827899 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-929048bf-0664-4cb8-ba64-5240b1a37913 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:47.828424 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-929048bf-0664-4cb8-ba64-5240b1a37913 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:47.855325 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-79b2e3ad-5bd2-4bfc-a64c-7ea299f168df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:47.858590 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-929048bf-0664-4cb8-ba64-5240b1a37913 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b/ips" status: 200 len: 150 microversion: 2.1 time: 0.050819 May 10 03:20:47.859231 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 121/252] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 10 03:20:47 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b/ips => generated 150 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:47.864481 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-79b2e3ad-5bd2-4bfc-a64c-7ea299f168df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1722 microversion: 2.1 time: 0.164423 May 10 03:20:47.865057 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 132/253] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:47 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:48.109383 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-b92ec3e4-6d5f-43b7-9201-3b21408cb207 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:48.109974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-b92ec3e4-6d5f-43b7-9201-3b21408cb207 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:48.115751 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b92ec3e4-6d5f-43b7-9201-3b21408cb207 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:48.116738 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b92ec3e4-6d5f-43b7-9201-3b21408cb207 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:48.117501 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b92ec3e4-6d5f-43b7-9201-3b21408cb207 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:48.117938 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b92ec3e4-6d5f-43b7-9201-3b21408cb207 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:48.245762 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-b92ec3e4-6d5f-43b7-9201-3b21408cb207 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:48.254182 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-b92ec3e4-6d5f-43b7-9201-3b21408cb207 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:48.255869 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-b92ec3e4-6d5f-43b7-9201-3b21408cb207 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:48.257339 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-b92ec3e4-6d5f-43b7-9201-3b21408cb207 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1722 microversion: 2.20 time: 0.151839 May 10 03:20:48.258066 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 122/254] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:20:48 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:48.716799 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-81484af4-29a3-4590-9323-2e4fb738d14f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:48.717453 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-81484af4-29a3-4590-9323-2e4fb738d14f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:48.724275 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-81484af4-29a3-4590-9323-2e4fb738d14f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:48.724727 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-81484af4-29a3-4590-9323-2e4fb738d14f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:48.726135 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-81484af4-29a3-4590-9323-2e4fb738d14f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:48.726613 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-81484af4-29a3-4590-9323-2e4fb738d14f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:48.869222 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-81484af4-29a3-4590-9323-2e4fb738d14f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:48.876890 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-81484af4-29a3-4590-9323-2e4fb738d14f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.164161 May 10 03:20:48.877630 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 133/255] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:48 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:48.883339 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-1dbe4458-44b1-4ea6-9843-728f76a6ff2a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:48.884061 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-1dbe4458-44b1-4ea6-9843-728f76a6ff2a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:48.892777 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1dbe4458-44b1-4ea6-9843-728f76a6ff2a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:48.893230 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1dbe4458-44b1-4ea6-9843-728f76a6ff2a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:48.893999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1dbe4458-44b1-4ea6-9843-728f76a6ff2a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:48.894467 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1dbe4458-44b1-4ea6-9843-728f76a6ff2a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:49.047001 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1dbe4458-44b1-4ea6-9843-728f76a6ff2a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:49.058220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-1dbe4458-44b1-4ea6-9843-728f76a6ff2a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1722 microversion: 2.1 time: 0.179328 May 10 03:20:49.060169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 123/256] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:48 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:49.276918 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-15b92480-0bf2-4b4c-a8e1-3975f9cffb1a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:49.277519 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-15b92480-0bf2-4b4c-a8e1-3975f9cffb1a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:49.283456 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-15b92480-0bf2-4b4c-a8e1-3975f9cffb1a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:49.283903 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-15b92480-0bf2-4b4c-a8e1-3975f9cffb1a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:49.284698 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-15b92480-0bf2-4b4c-a8e1-3975f9cffb1a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:49.285135 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-15b92480-0bf2-4b4c-a8e1-3975f9cffb1a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:49.419924 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-15b92480-0bf2-4b4c-a8e1-3975f9cffb1a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:49.427661 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-15b92480-0bf2-4b4c-a8e1-3975f9cffb1a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:49.429730 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-15b92480-0bf2-4b4c-a8e1-3975f9cffb1a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:49.430890 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-15b92480-0bf2-4b4c-a8e1-3975f9cffb1a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1722 microversion: 2.20 time: 0.158521 May 10 03:20:49.431632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 134/257] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:20:49 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:49.614341 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-bde23063-5ac8-4ca8-9058-748003660c1f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc46e0f6-ea49-48d7-9af0-6488aec07e24"}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:49.621489 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-bde23063-5ac8-4ca8-9058-748003660c1f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:49.627732 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bde23063-5ac8-4ca8-9058-748003660c1f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:49.628230 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bde23063-5ac8-4ca8-9058-748003660c1f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:49.629006 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bde23063-5ac8-4ca8-9058-748003660c1f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:49.629438 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bde23063-5ac8-4ca8-9058-748003660c1f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:49.893711 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c8d6397d-f2c6-4c5c-bcd1-620e47b3b5e9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:49.894317 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-c8d6397d-f2c6-4c5c-bcd1-620e47b3b5e9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:49.901140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c8d6397d-f2c6-4c5c-bcd1-620e47b3b5e9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:49.901751 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c8d6397d-f2c6-4c5c-bcd1-620e47b3b5e9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:49.908632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c8d6397d-f2c6-4c5c-bcd1-620e47b3b5e9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:49.908632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c8d6397d-f2c6-4c5c-bcd1-620e47b3b5e9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:50.035974 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-c8d6397d-f2c6-4c5c-bcd1-620e47b3b5e9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:50.044140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-c8d6397d-f2c6-4c5c-bcd1-620e47b3b5e9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.154226 May 10 03:20:50.044707 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 135/258] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:49 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:50.076265 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-530ec683-cd5d-4e6d-8593-b64c9cfb4ade tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:50.076868 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-530ec683-cd5d-4e6d-8593-b64c9cfb4ade tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:50.083122 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-530ec683-cd5d-4e6d-8593-b64c9cfb4ade tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:50.083579 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-530ec683-cd5d-4e6d-8593-b64c9cfb4ade tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:50.084405 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-530ec683-cd5d-4e6d-8593-b64c9cfb4ade tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:50.085340 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-530ec683-cd5d-4e6d-8593-b64c9cfb4ade tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:50.212285 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-530ec683-cd5d-4e6d-8593-b64c9cfb4ade tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:50.220112 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-530ec683-cd5d-4e6d-8593-b64c9cfb4ade tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1722 microversion: 2.1 time: 0.147707 May 10 03:20:50.220681 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 136/259] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:50 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:50.336559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-bde23063-5ac8-4ca8-9058-748003660c1f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "POST /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.726684 May 10 03:20:50.337247 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 124/260] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 03:20:49 2022] POST /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b/os-volume_attachments => generated 194 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:20:50.449160 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-37474f70-292b-4fe3-9703-2d7da83fb74b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:50.449687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-37474f70-292b-4fe3-9703-2d7da83fb74b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:50.455833 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-37474f70-292b-4fe3-9703-2d7da83fb74b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:50.456366 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-37474f70-292b-4fe3-9703-2d7da83fb74b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:50.457080 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-37474f70-292b-4fe3-9703-2d7da83fb74b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:50.457513 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-37474f70-292b-4fe3-9703-2d7da83fb74b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:50.590723 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-37474f70-292b-4fe3-9703-2d7da83fb74b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:50.604779 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-37474f70-292b-4fe3-9703-2d7da83fb74b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:50.607382 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-37474f70-292b-4fe3-9703-2d7da83fb74b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:50.607382 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-37474f70-292b-4fe3-9703-2d7da83fb74b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1722 microversion: 2.20 time: 0.162243 May 10 03:20:50.608135 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 137/261] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:20:50 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:51.061915 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-f593cd3b-2812-42f8-94b3-d5c7c77c06ef tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:51.062604 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-f593cd3b-2812-42f8-94b3-d5c7c77c06ef tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:51.068833 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f593cd3b-2812-42f8-94b3-d5c7c77c06ef tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:51.069847 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f593cd3b-2812-42f8-94b3-d5c7c77c06ef tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:51.070616 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f593cd3b-2812-42f8-94b3-d5c7c77c06ef tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:51.071063 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f593cd3b-2812-42f8-94b3-d5c7c77c06ef tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:51.202789 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-f593cd3b-2812-42f8-94b3-d5c7c77c06ef tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:51.210196 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-f593cd3b-2812-42f8-94b3-d5c7c77c06ef tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.152884 May 10 03:20:51.210829 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 125/262] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:51 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:51.245300 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-825ddcbe-75aa-45a5-a4f2-eaccc32ba9ba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:51.245300 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-825ddcbe-75aa-45a5-a4f2-eaccc32ba9ba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:51.249370 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-825ddcbe-75aa-45a5-a4f2-eaccc32ba9ba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:51.249820 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-825ddcbe-75aa-45a5-a4f2-eaccc32ba9ba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:51.250585 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-825ddcbe-75aa-45a5-a4f2-eaccc32ba9ba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:51.251016 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-825ddcbe-75aa-45a5-a4f2-eaccc32ba9ba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:51.393341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-825ddcbe-75aa-45a5-a4f2-eaccc32ba9ba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:51.401415 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-825ddcbe-75aa-45a5-a4f2-eaccc32ba9ba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1722 microversion: 2.1 time: 0.163511 May 10 03:20:51.401989 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 138/263] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:51 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:51.626508 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-900309c0-19e0-477b-a3ac-c8fa25207d65 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:51.627365 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-900309c0-19e0-477b-a3ac-c8fa25207d65 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:51.634486 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-900309c0-19e0-477b-a3ac-c8fa25207d65 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:51.634802 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-900309c0-19e0-477b-a3ac-c8fa25207d65 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:51.635848 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-900309c0-19e0-477b-a3ac-c8fa25207d65 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:51.636350 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-900309c0-19e0-477b-a3ac-c8fa25207d65 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:51.771009 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-900309c0-19e0-477b-a3ac-c8fa25207d65 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:51.779353 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-900309c0-19e0-477b-a3ac-c8fa25207d65 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:51.780958 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-900309c0-19e0-477b-a3ac-c8fa25207d65 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:51.782113 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-900309c0-19e0-477b-a3ac-c8fa25207d65 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1722 microversion: 2.20 time: 0.159699 May 10 03:20:51.782723 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 126/264] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:20:51 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:52.226943 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-14d8dc99-5a2e-450f-8d9f-4ae2f4ddabcc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:52.227786 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-14d8dc99-5a2e-450f-8d9f-4ae2f4ddabcc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:52.234071 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-14d8dc99-5a2e-450f-8d9f-4ae2f4ddabcc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:52.234529 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-14d8dc99-5a2e-450f-8d9f-4ae2f4ddabcc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:52.235308 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-14d8dc99-5a2e-450f-8d9f-4ae2f4ddabcc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:52.235746 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-14d8dc99-5a2e-450f-8d9f-4ae2f4ddabcc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:52.365426 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-14d8dc99-5a2e-450f-8d9f-4ae2f4ddabcc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:52.373304 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-14d8dc99-5a2e-450f-8d9f-4ae2f4ddabcc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.150342 May 10 03:20:52.373886 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 139/265] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:52 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:52.425401 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-3bdd035a-1800-4037-9147-4d844bdff691 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:52.427524 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-3bdd035a-1800-4037-9147-4d844bdff691 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:52.443902 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3bdd035a-1800-4037-9147-4d844bdff691 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:52.445760 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3bdd035a-1800-4037-9147-4d844bdff691 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:52.447488 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3bdd035a-1800-4037-9147-4d844bdff691 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:52.448473 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3bdd035a-1800-4037-9147-4d844bdff691 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:52.621761 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-3bdd035a-1800-4037-9147-4d844bdff691 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:52.627135 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-6c7d69e9-608a-4686-be16-2db29f39d4cf tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Action: 'create', calling method: .version_select at 0x7f6a5dd2b0d0>, body: {"keypair": {"name": "tempest-keypair-1153280867", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAS1H2DIzAO8IHELC/75KnzhjhcKeY1aC/QbYoqfRx0l3dHjmQtbLbipoaSafSHD9NVIvBFfGLD5i8Wk1LObenS6XtxkxCRD4l5q4JkKw3pXLCTirLouXPTsIW6iKfmUA=="}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:52.630491 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-3bdd035a-1800-4037-9147-4d844bdff691 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1722 microversion: 2.1 time: 0.214218 May 10 03:20:52.644173 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 127/266] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:52 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:52.655052 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-6c7d69e9-608a-4686-be16-2db29f39d4cf tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Getting quotas for project 0b7c607953b94c02977d60c0b0536e24. Resources: {'key_pairs'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:20:52.658964 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-6c7d69e9-608a-4686-be16-2db29f39d4cf tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Getting quotas for user 9407e88fdbd74ba196ffd9fd221e15f5 and project 0b7c607953b94c02977d60c0b0536e24. Resources: {'key_pairs'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:20:52.733188 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-6c7d69e9-608a-4686-be16-2db29f39d4cf tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.113550 May 10 03:20:52.734243 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 140/267] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 10 03:20:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:20:52.800611 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-ce233238-ec63-455a-8e1a-299f17fc9afb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:52.801219 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-ce233238-ec63-455a-8e1a-299f17fc9afb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:52.808403 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ce233238-ec63-455a-8e1a-299f17fc9afb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:52.808857 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ce233238-ec63-455a-8e1a-299f17fc9afb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:52.809731 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ce233238-ec63-455a-8e1a-299f17fc9afb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:52.810168 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ce233238-ec63-455a-8e1a-299f17fc9afb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:52.978037 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ce233238-ec63-455a-8e1a-299f17fc9afb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:52.986962 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ce233238-ec63-455a-8e1a-299f17fc9afb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:52.988501 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ce233238-ec63-455a-8e1a-299f17fc9afb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:52.989675 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-ce233238-ec63-455a-8e1a-299f17fc9afb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1722 microversion: 2.20 time: 0.193061 May 10 03:20:52.990250 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 128/268] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:20:52 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:53.390796 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-419bbd1a-bbf3-47ba-851d-f8c88bfc0aed tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:53.391567 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-419bbd1a-bbf3-47ba-851d-f8c88bfc0aed tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:53.398681 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-419bbd1a-bbf3-47ba-851d-f8c88bfc0aed tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:53.399134 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-419bbd1a-bbf3-47ba-851d-f8c88bfc0aed tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:53.399917 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-419bbd1a-bbf3-47ba-851d-f8c88bfc0aed tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:53.400386 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-419bbd1a-bbf3-47ba-851d-f8c88bfc0aed tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:53.543348 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-419bbd1a-bbf3-47ba-851d-f8c88bfc0aed tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:53.550928 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-419bbd1a-bbf3-47ba-851d-f8c88bfc0aed tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.164156 May 10 03:20:53.551528 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 141/269] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:53 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:53.651695 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-d03bae93-f4cf-4ef7-82b7-ffb00febb144 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:53.652323 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-d03bae93-f4cf-4ef7-82b7-ffb00febb144 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:53.658126 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d03bae93-f4cf-4ef7-82b7-ffb00febb144 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:53.658577 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d03bae93-f4cf-4ef7-82b7-ffb00febb144 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:53.659334 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d03bae93-f4cf-4ef7-82b7-ffb00febb144 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:53.659764 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d03bae93-f4cf-4ef7-82b7-ffb00febb144 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:53.817693 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-d03bae93-f4cf-4ef7-82b7-ffb00febb144 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:53.826106 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-d03bae93-f4cf-4ef7-82b7-ffb00febb144 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1722 microversion: 2.1 time: 0.178240 May 10 03:20:53.826748 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 129/270] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:53 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:54.008465 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-974a697f-3220-430f-a2d5-20a452a86b8e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:54.009079 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-974a697f-3220-430f-a2d5-20a452a86b8e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:54.014954 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-974a697f-3220-430f-a2d5-20a452a86b8e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:54.015405 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-974a697f-3220-430f-a2d5-20a452a86b8e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:54.016209 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-974a697f-3220-430f-a2d5-20a452a86b8e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:54.016646 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-974a697f-3220-430f-a2d5-20a452a86b8e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:54.163389 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-974a697f-3220-430f-a2d5-20a452a86b8e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:54.172440 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-974a697f-3220-430f-a2d5-20a452a86b8e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:54.174722 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-974a697f-3220-430f-a2d5-20a452a86b8e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:54.176090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-974a697f-3220-430f-a2d5-20a452a86b8e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1722 microversion: 2.20 time: 0.171681 May 10 03:20:54.186667 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 142/271] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:20:54 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:54.568505 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-f3f4343b-ef96-4d28-b43c-a2bc9137c486 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:54.569150 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-f3f4343b-ef96-4d28-b43c-a2bc9137c486 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:54.575331 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f3f4343b-ef96-4d28-b43c-a2bc9137c486 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:54.576243 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f3f4343b-ef96-4d28-b43c-a2bc9137c486 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:54.577201 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f3f4343b-ef96-4d28-b43c-a2bc9137c486 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:54.577878 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f3f4343b-ef96-4d28-b43c-a2bc9137c486 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:54.720630 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-f3f4343b-ef96-4d28-b43c-a2bc9137c486 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:54.729139 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-f3f4343b-ef96-4d28-b43c-a2bc9137c486 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.164440 May 10 03:20:54.730108 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 130/272] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:54 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:54.843995 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-30137c9a-3880-4d21-aaa8-b57986aa5442 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:54.844674 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-30137c9a-3880-4d21-aaa8-b57986aa5442 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:54.854857 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-30137c9a-3880-4d21-aaa8-b57986aa5442 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:54.855412 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-30137c9a-3880-4d21-aaa8-b57986aa5442 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:54.856303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-30137c9a-3880-4d21-aaa8-b57986aa5442 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:54.856904 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-30137c9a-3880-4d21-aaa8-b57986aa5442 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:54.993871 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-30137c9a-3880-4d21-aaa8-b57986aa5442 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:55.001887 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-30137c9a-3880-4d21-aaa8-b57986aa5442 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1722 microversion: 2.1 time: 0.161827 May 10 03:20:55.002452 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 143/273] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:54 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:55.194277 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-82096df5-bbc0-4979-b6c9-39f33bda2c66 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:55.195007 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-82096df5-bbc0-4979-b6c9-39f33bda2c66 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:55.205196 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-82096df5-bbc0-4979-b6c9-39f33bda2c66 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:55.205642 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-82096df5-bbc0-4979-b6c9-39f33bda2c66 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:55.206421 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-82096df5-bbc0-4979-b6c9-39f33bda2c66 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:55.206875 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-82096df5-bbc0-4979-b6c9-39f33bda2c66 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:55.270870 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-b470617b-58d0-4048-ba2d-e5a0cae36bb2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1683406219", "imageRef": "7ce6e103-a571-4b59-9162-ff1107650c97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1e0211ea-07f5-489a-bffd-a2279bfba53a"}], "security_groups": [{"name": "tempest-securitygroup--685193173"}], "key_name": "tempest-keypair-1153280867", "user_data": "}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:55.345104 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-82096df5-bbc0-4979-b6c9-39f33bda2c66 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:55.353409 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-82096df5-bbc0-4979-b6c9-39f33bda2c66 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:55.354938 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-82096df5-bbc0-4979-b6c9-39f33bda2c66 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:55.356168 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-82096df5-bbc0-4979-b6c9-39f33bda2c66 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1722 microversion: 2.20 time: 0.165931 May 10 03:20:55.359755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 131/274] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:20:55 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:55.377238 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.network.neutron [None req-b470617b-58d0-4048-ba2d-e5a0cae36bb2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] validate_networks() for [('1e0211ea-07f5-489a-bffd-a2279bfba53a', None, None, None, None, None)] {{(pid=117399) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:20:55.746427 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-ab8aabbe-e548-4270-b262-662e7768f50e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:55.762442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-ab8aabbe-e548-4270-b262-662e7768f50e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:55.762442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ab8aabbe-e548-4270-b262-662e7768f50e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:55.762442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ab8aabbe-e548-4270-b262-662e7768f50e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:55.762442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ab8aabbe-e548-4270-b262-662e7768f50e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:55.763522 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ab8aabbe-e548-4270-b262-662e7768f50e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:55.764253 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-b470617b-58d0-4048-ba2d-e5a0cae36bb2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Flavor limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:20:55.765097 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-b470617b-58d0-4048-ba2d-e5a0cae36bb2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Image limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:20:55.765594 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-b470617b-58d0-4048-ba2d-e5a0cae36bb2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Flavor pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:20:55.766048 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-b470617b-58d0-4048-ba2d-e5a0cae36bb2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Image pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:20:55.766523 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-b470617b-58d0-4048-ba2d-e5a0cae36bb2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:20:55.777166 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b470617b-58d0-4048-ba2d-e5a0cae36bb2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:55.777752 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b470617b-58d0-4048-ba2d-e5a0cae36bb2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:55.778605 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b470617b-58d0-4048-ba2d-e5a0cae36bb2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:55.779046 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b470617b-58d0-4048-ba2d-e5a0cae36bb2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:55.797486 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-b470617b-58d0-4048-ba2d-e5a0cae36bb2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Getting quotas for project 0b7c607953b94c02977d60c0b0536e24. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:20:55.804038 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-b470617b-58d0-4048-ba2d-e5a0cae36bb2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Getting quotas for user 9407e88fdbd74ba196ffd9fd221e15f5 and project 0b7c607953b94c02977d60c0b0536e24. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:20:55.816129 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-b470617b-58d0-4048-ba2d-e5a0cae36bb2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Going to run 1 instances... {{(pid=117399) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:20:55.819389 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-b470617b-58d0-4048-ba2d-e5a0cae36bb2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ce6e103-a571-4b59-9162-ff1107650c97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:20:55.895961 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ab8aabbe-e548-4270-b262-662e7768f50e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:55.903861 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-ab8aabbe-e548-4270-b262-662e7768f50e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.161361 May 10 03:20:55.904462 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 132/275] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:55 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:56.018734 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-8a5a560e-73a9-4c07-9d3b-663b7c451fb0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:56.019488 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-8a5a560e-73a9-4c07-9d3b-663b7c451fb0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:56.031083 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8a5a560e-73a9-4c07-9d3b-663b7c451fb0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:56.031083 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8a5a560e-73a9-4c07-9d3b-663b7c451fb0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:56.031083 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8a5a560e-73a9-4c07-9d3b-663b7c451fb0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:56.031083 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8a5a560e-73a9-4c07-9d3b-663b7c451fb0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:56.138955 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-b470617b-58d0-4048-ba2d-e5a0cae36bb2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.872331 May 10 03:20:56.140526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 144/276] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 03:20:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 03:20:56.151785 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-54c5ebf1-3315-4d37-93a4-924efbfb4854 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:56.152718 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-54c5ebf1-3315-4d37-93a4-924efbfb4854 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:56.192752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-8a5a560e-73a9-4c07-9d3b-663b7c451fb0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:56.203829 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-8a5a560e-73a9-4c07-9d3b-663b7c451fb0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1722 microversion: 2.1 time: 0.188829 May 10 03:20:56.204942 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 133/277] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:56 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:56.221571 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-54c5ebf1-3315-4d37-93a4-924efbfb4854 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:56.229744 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-54c5ebf1-3315-4d37-93a4-924efbfb4854 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1242 microversion: 2.1 time: 0.083192 May 10 03:20:56.234418 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 145/278] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:56 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:56.374395 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-6ab28043-ba54-454a-9fee-8950a6c49ffb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:56.375005 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-6ab28043-ba54-454a-9fee-8950a6c49ffb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:56.380970 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6ab28043-ba54-454a-9fee-8950a6c49ffb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:56.382071 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6ab28043-ba54-454a-9fee-8950a6c49ffb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:56.383327 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6ab28043-ba54-454a-9fee-8950a6c49ffb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:56.383780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6ab28043-ba54-454a-9fee-8950a6c49ffb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:56.531829 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-6ab28043-ba54-454a-9fee-8950a6c49ffb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:56.544771 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-6ab28043-ba54-454a-9fee-8950a6c49ffb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:56.546369 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-6ab28043-ba54-454a-9fee-8950a6c49ffb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:56.547629 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-6ab28043-ba54-454a-9fee-8950a6c49ffb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1722 microversion: 2.20 time: 0.177186 May 10 03:20:56.548316 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 134/279] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:20:56 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:56.920838 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-25a5046f-b4ef-45cc-b285-ec9c92bc3f3f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:56.921444 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-25a5046f-b4ef-45cc-b285-ec9c92bc3f3f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:56.927759 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-25a5046f-b4ef-45cc-b285-ec9c92bc3f3f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:56.928300 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-25a5046f-b4ef-45cc-b285-ec9c92bc3f3f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:56.929067 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-25a5046f-b4ef-45cc-b285-ec9c92bc3f3f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:56.929502 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-25a5046f-b4ef-45cc-b285-ec9c92bc3f3f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:57.065390 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-25a5046f-b4ef-45cc-b285-ec9c92bc3f3f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:57.073200 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-25a5046f-b4ef-45cc-b285-ec9c92bc3f3f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.156289 May 10 03:20:57.074909 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 146/280] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:56 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:57.222911 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-6b218d4c-cf28-4f4b-81bb-6aac7c92e628 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:57.223517 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-6b218d4c-cf28-4f4b-81bb-6aac7c92e628 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:57.230037 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6b218d4c-cf28-4f4b-81bb-6aac7c92e628 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:57.230490 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6b218d4c-cf28-4f4b-81bb-6aac7c92e628 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:57.231263 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6b218d4c-cf28-4f4b-81bb-6aac7c92e628 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:57.231701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6b218d4c-cf28-4f4b-81bb-6aac7c92e628 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:57.250247 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-10aa2022-aeec-4b6f-b9de-ab8a5f04b522 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:57.251051 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-10aa2022-aeec-4b6f-b9de-ab8a5f04b522 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:57.257601 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-10aa2022-aeec-4b6f-b9de-ab8a5f04b522 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:57.258056 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-10aa2022-aeec-4b6f-b9de-ab8a5f04b522 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:57.258830 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-10aa2022-aeec-4b6f-b9de-ab8a5f04b522 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:57.259272 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-10aa2022-aeec-4b6f-b9de-ab8a5f04b522 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:57.328598 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-10aa2022-aeec-4b6f-b9de-ab8a5f04b522 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:57.337450 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-10aa2022-aeec-4b6f-b9de-ab8a5f04b522 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1246 microversion: 2.1 time: 0.091288 May 10 03:20:57.338027 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 147/281] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:57 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:57.389392 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-6b218d4c-cf28-4f4b-81bb-6aac7c92e628 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:57.397693 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-6b218d4c-cf28-4f4b-81bb-6aac7c92e628 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1722 microversion: 2.1 time: 0.178048 May 10 03:20:57.401156 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 135/282] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:57 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:57.566818 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-5d701f09-4cf9-4d27-9bf2-6fea1f86ee27 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:57.568286 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-5d701f09-4cf9-4d27-9bf2-6fea1f86ee27 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:57.574600 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5d701f09-4cf9-4d27-9bf2-6fea1f86ee27 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:57.575529 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5d701f09-4cf9-4d27-9bf2-6fea1f86ee27 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:57.576636 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5d701f09-4cf9-4d27-9bf2-6fea1f86ee27 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:57.577016 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5d701f09-4cf9-4d27-9bf2-6fea1f86ee27 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:57.725270 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-5d701f09-4cf9-4d27-9bf2-6fea1f86ee27 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:57.733280 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-5d701f09-4cf9-4d27-9bf2-6fea1f86ee27 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:57.734792 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-5d701f09-4cf9-4d27-9bf2-6fea1f86ee27 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:57.735951 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-5d701f09-4cf9-4d27-9bf2-6fea1f86ee27 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1722 microversion: 2.20 time: 0.173113 May 10 03:20:57.736536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 148/283] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:20:57 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:20:58.090207 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-5ec4ef0d-fc11-404c-9097-72b64560a81a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:58.091165 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-5ec4ef0d-fc11-404c-9097-72b64560a81a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:58.097735 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5ec4ef0d-fc11-404c-9097-72b64560a81a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:58.098192 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5ec4ef0d-fc11-404c-9097-72b64560a81a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:58.098973 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5ec4ef0d-fc11-404c-9097-72b64560a81a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:58.099410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5ec4ef0d-fc11-404c-9097-72b64560a81a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:58.144337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ecadc77f-c2ac-4377-acb8-ba96ee6630ef tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1784340469", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1309171344", "security_groups": [{"name": "tempest-secgroup-smoke-136941773"}], "networks": [{"uuid": "f7af8e2a-dbcc-4511-a892-852e6c171e4a"}], "block_device_mapping_v2": [{"uuid": "ef882bf7-02e6-4e71-a82c-570eb3226ba9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:20:58.288574 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5ec4ef0d-fc11-404c-9097-72b64560a81a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:58.291579 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.network.neutron [None req-ecadc77f-c2ac-4377-acb8-ba96ee6630ef tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] validate_networks() for [('f7af8e2a-dbcc-4511-a892-852e6c171e4a', None, None, None, None, None)] {{(pid=117399) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:20:58.301415 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-5ec4ef0d-fc11-404c-9097-72b64560a81a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.214938 May 10 03:20:58.302176 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 136/284] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:58 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:58.358060 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-8ed4c691-a33b-4694-8460-b6e93afbbdee tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:58.358681 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-8ed4c691-a33b-4694-8460-b6e93afbbdee tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:58.369455 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8ed4c691-a33b-4694-8460-b6e93afbbdee tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:58.369973 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8ed4c691-a33b-4694-8460-b6e93afbbdee tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:58.370781 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8ed4c691-a33b-4694-8460-b6e93afbbdee tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:58.371351 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8ed4c691-a33b-4694-8460-b6e93afbbdee tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:58.458750 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-8ed4c691-a33b-4694-8460-b6e93afbbdee tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:58.474794 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-8ed4c691-a33b-4694-8460-b6e93afbbdee tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1302 microversion: 2.1 time: 0.122187 May 10 03:20:58.477309 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 137/285] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:58 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1302 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:58.480311 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-f82f5dfe-fa50-4676-bcab-7419813991f0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:58.481082 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-f82f5dfe-fa50-4676-bcab-7419813991f0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:58.488629 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f82f5dfe-fa50-4676-bcab-7419813991f0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:58.489311 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f82f5dfe-fa50-4676-bcab-7419813991f0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:58.490152 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f82f5dfe-fa50-4676-bcab-7419813991f0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:58.491130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f82f5dfe-fa50-4676-bcab-7419813991f0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:58.698157 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-f82f5dfe-fa50-4676-bcab-7419813991f0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:58.714897 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-f82f5dfe-fa50-4676-bcab-7419813991f0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1722 microversion: 2.1 time: 0.238415 May 10 03:20:58.715776 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 138/286] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:58 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:58.754843 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-cbba2b1d-5987-4e49-85bf-3e9888d2599c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:58.755577 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-cbba2b1d-5987-4e49-85bf-3e9888d2599c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:58.767643 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cbba2b1d-5987-4e49-85bf-3e9888d2599c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:58.767643 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cbba2b1d-5987-4e49-85bf-3e9888d2599c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:58.767643 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cbba2b1d-5987-4e49-85bf-3e9888d2599c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:58.767643 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cbba2b1d-5987-4e49-85bf-3e9888d2599c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:58.854942 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-ecadc77f-c2ac-4377-acb8-ba96ee6630ef tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Flavor limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:20:58.855467 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-ecadc77f-c2ac-4377-acb8-ba96ee6630ef tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Image limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:20:58.856514 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-ecadc77f-c2ac-4377-acb8-ba96ee6630ef tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Flavor pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:20:58.857200 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-ecadc77f-c2ac-4377-acb8-ba96ee6630ef tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Image pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:20:58.858525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-ecadc77f-c2ac-4377-acb8-ba96ee6630ef tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:20:58.868634 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ecadc77f-c2ac-4377-acb8-ba96ee6630ef tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:58.869422 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ecadc77f-c2ac-4377-acb8-ba96ee6630ef tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:58.870419 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ecadc77f-c2ac-4377-acb8-ba96ee6630ef tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:58.871093 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ecadc77f-c2ac-4377-acb8-ba96ee6630ef tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:58.899469 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-ecadc77f-c2ac-4377-acb8-ba96ee6630ef tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Getting quotas for project 4524e2de8e8e4dbfa1cb85515dbeb90a. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:20:58.904239 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-ecadc77f-c2ac-4377-acb8-ba96ee6630ef tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Getting quotas for user a49b27f57e9049518e157d39f6901bd7 and project 4524e2de8e8e4dbfa1cb85515dbeb90a. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:20:58.932263 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-cbba2b1d-5987-4e49-85bf-3e9888d2599c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:58.948740 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-cbba2b1d-5987-4e49-85bf-3e9888d2599c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:58.950501 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-cbba2b1d-5987-4e49-85bf-3e9888d2599c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:58.951903 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-cbba2b1d-5987-4e49-85bf-3e9888d2599c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1722 microversion: 2.20 time: 0.201229 May 10 03:20:58.952800 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 139/287] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:20:58 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:20:58.977647 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ecadc77f-c2ac-4377-acb8-ba96ee6630ef tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Going to run 1 instances... {{(pid=117399) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:20:58.980094 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ecadc77f-c2ac-4377-acb8-ba96ee6630ef tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ef882bf7-02e6-4e71-a82c-570eb3226ba9',volume_size=None,volume_type=None)] {{(pid=117399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:20:59.319157 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-e2d842f1-bff9-4f61-b45d-812cd0862aa6 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:59.319776 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-e2d842f1-bff9-4f61-b45d-812cd0862aa6 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:59.326580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e2d842f1-bff9-4f61-b45d-812cd0862aa6 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:59.327054 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e2d842f1-bff9-4f61-b45d-812cd0862aa6 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:59.327954 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e2d842f1-bff9-4f61-b45d-812cd0862aa6 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:59.334039 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e2d842f1-bff9-4f61-b45d-812cd0862aa6 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:59.489688 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-e2d842f1-bff9-4f61-b45d-812cd0862aa6 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:59.498139 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-e2d842f1-bff9-4f61-b45d-812cd0862aa6 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.183060 May 10 03:20:59.512385 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 140/288] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:59 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:20:59.512608 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ecadc77f-c2ac-4377-acb8-ba96ee6630ef tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.364125 May 10 03:20:59.513038 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-8e41b095-eb3f-410d-aa12-0fed7d067e79 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:59.513038 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-8e41b095-eb3f-410d-aa12-0fed7d067e79 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:59.513226 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 149/289] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 03:20:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 1371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:20:59.517101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-5e15f3fd-628b-4c09-95b5-0d9473280022 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:59.517729 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-5e15f3fd-628b-4c09-95b5-0d9473280022 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:59.518434 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8e41b095-eb3f-410d-aa12-0fed7d067e79 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:59.519146 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8e41b095-eb3f-410d-aa12-0fed7d067e79 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:59.520131 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8e41b095-eb3f-410d-aa12-0fed7d067e79 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:59.520539 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8e41b095-eb3f-410d-aa12-0fed7d067e79 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:59.599782 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-5e15f3fd-628b-4c09-95b5-0d9473280022 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:20:59.609073 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-5e15f3fd-628b-4c09-95b5-0d9473280022 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1089 microversion: 2.1 time: 0.096766 May 10 03:20:59.610980 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 150/290] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:59 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1089 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:20:59.734268 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-45e5542c-060f-4fd7-ae7a-49a6758dffdb tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:20:59.735002 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-45e5542c-060f-4fd7-ae7a-49a6758dffdb tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:20:59.743371 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-45e5542c-060f-4fd7-ae7a-49a6758dffdb tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:59.743925 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-45e5542c-060f-4fd7-ae7a-49a6758dffdb tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:20:59.744887 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-45e5542c-060f-4fd7-ae7a-49a6758dffdb tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:20:59.745802 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-45e5542c-060f-4fd7-ae7a-49a6758dffdb tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:00.055958 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-8e41b095-eb3f-410d-aa12-0fed7d067e79 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:00.074927 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-8e41b095-eb3f-410d-aa12-0fed7d067e79 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1367 microversion: 2.1 time: 0.568661 May 10 03:21:00.076410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 141/291] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:59 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1367 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:00.089495 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-45e5542c-060f-4fd7-ae7a-49a6758dffdb tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:00.097951 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-45e5542c-060f-4fd7-ae7a-49a6758dffdb tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1722 microversion: 2.1 time: 0.368433 May 10 03:21:00.098535 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 151/292] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:20:59 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1722 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:21:00.106102 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-4cfec39a-4de7-4beb-889b-ae571f4c0dea tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:00.107845 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-4cfec39a-4de7-4beb-889b-ae571f4c0dea tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:00.123117 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4cfec39a-4de7-4beb-889b-ae571f4c0dea tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:00.124394 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4cfec39a-4de7-4beb-889b-ae571f4c0dea tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:00.125478 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4cfec39a-4de7-4beb-889b-ae571f4c0dea tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:00.126594 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4cfec39a-4de7-4beb-889b-ae571f4c0dea tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:00.335569 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-4cfec39a-4de7-4beb-889b-ae571f4c0dea tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:00.351127 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-4cfec39a-4de7-4beb-889b-ae571f4c0dea tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:00.352833 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-4cfec39a-4de7-4beb-889b-ae571f4c0dea tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:00.354007 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-4cfec39a-4de7-4beb-889b-ae571f4c0dea tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1722 microversion: 2.20 time: 0.269512 May 10 03:21:00.356035 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 142/293] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:00 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:00.398036 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-33914efb-f94e-4dd5-85cd-f3bf3a21ef7f req-0fea8317-ae35-4453-aaf0-5c306bcb17d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25e932f1-fc8d-4515-b33f-e1ba788e850b", "tag": "e00eeae9-db9b-46b3-b858-0190082d908f"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:00.409638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-33914efb-f94e-4dd5-85cd-f3bf3a21ef7f req-0fea8317-ae35-4453-aaf0-5c306bcb17d0 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:00.415175 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-33914efb-f94e-4dd5-85cd-f3bf3a21ef7f req-0fea8317-ae35-4453-aaf0-5c306bcb17d0 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:00.428967 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-33914efb-f94e-4dd5-85cd-f3bf3a21ef7f req-0fea8317-ae35-4453-aaf0-5c306bcb17d0 service nova] Creating event network-changed:e00eeae9-db9b-46b3-b858-0190082d908f for instance 25e932f1-fc8d-4515-b33f-e1ba788e850b on hv-cinder-83009 May 10 03:21:00.435110 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-33914efb-f94e-4dd5-85cd-f3bf3a21ef7f req-0fea8317-ae35-4453-aaf0-5c306bcb17d0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045542 May 10 03:21:00.436045 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 152/294] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:00.520444 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-3f529921-4497-4870-8972-69aed0c201d8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:00.521072 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-3f529921-4497-4870-8972-69aed0c201d8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:00.528373 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3f529921-4497-4870-8972-69aed0c201d8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:00.528861 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3f529921-4497-4870-8972-69aed0c201d8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:00.540643 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3f529921-4497-4870-8972-69aed0c201d8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:00.541151 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3f529921-4497-4870-8972-69aed0c201d8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:00.630295 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-0abb4d4d-da3e-4ef1-9902-9dbbf982abbb tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:00.635212 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-0abb4d4d-da3e-4ef1-9902-9dbbf982abbb tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:00.718026 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-0abb4d4d-da3e-4ef1-9902-9dbbf982abbb tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:00.727460 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-0abb4d4d-da3e-4ef1-9902-9dbbf982abbb tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1089 microversion: 2.1 time: 0.102572 May 10 03:21:00.728389 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 153/295] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:00 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1089 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:21:00.749710 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-3f529921-4497-4870-8972-69aed0c201d8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:00.758273 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-3f529921-4497-4870-8972-69aed0c201d8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.242325 May 10 03:21:00.759065 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 143/296] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:00 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:01.094730 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-3c2573ef-ecf3-44a3-8166-9992203e6ec0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:01.095438 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-3c2573ef-ecf3-44a3-8166-9992203e6ec0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:01.101869 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3c2573ef-ecf3-44a3-8166-9992203e6ec0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:01.102382 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3c2573ef-ecf3-44a3-8166-9992203e6ec0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:01.103175 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3c2573ef-ecf3-44a3-8166-9992203e6ec0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:01.103614 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3c2573ef-ecf3-44a3-8166-9992203e6ec0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:01.116143 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-1949bde0-7c91-4a42-a698-426a45cc53d3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:01.116943 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-1949bde0-7c91-4a42-a698-426a45cc53d3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:01.122984 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1949bde0-7c91-4a42-a698-426a45cc53d3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:01.123463 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1949bde0-7c91-4a42-a698-426a45cc53d3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:01.124259 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1949bde0-7c91-4a42-a698-426a45cc53d3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:01.124857 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1949bde0-7c91-4a42-a698-426a45cc53d3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:01.303558 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-3c2573ef-ecf3-44a3-8166-9992203e6ec0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:01.311624 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-3c2573ef-ecf3-44a3-8166-9992203e6ec0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1367 microversion: 2.1 time: 0.220602 May 10 03:21:01.320316 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 154/297] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:01 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:01.325455 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1949bde0-7c91-4a42-a698-426a45cc53d3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:01.345683 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-1949bde0-7c91-4a42-a698-426a45cc53d3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1722 microversion: 2.1 time: 0.233593 May 10 03:21:01.355837 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 144/298] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:01 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:21:01.372300 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c0aaae69-9522-4078-83d4-97035c38da4f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:01.373031 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-c0aaae69-9522-4078-83d4-97035c38da4f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:01.378835 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c0aaae69-9522-4078-83d4-97035c38da4f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:01.379502 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c0aaae69-9522-4078-83d4-97035c38da4f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:01.380296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c0aaae69-9522-4078-83d4-97035c38da4f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:01.380888 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c0aaae69-9522-4078-83d4-97035c38da4f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:01.514907 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-c0aaae69-9522-4078-83d4-97035c38da4f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:01.524622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-c0aaae69-9522-4078-83d4-97035c38da4f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:01.526544 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-c0aaae69-9522-4078-83d4-97035c38da4f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:01.527349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-c0aaae69-9522-4078-83d4-97035c38da4f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1722 microversion: 2.20 time: 0.159172 May 10 03:21:01.527909 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 155/299] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:01 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:01.744502 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a5459943-3e12-41ff-acf7-401ed0f2f8f6 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:01.745236 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-a5459943-3e12-41ff-acf7-401ed0f2f8f6 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:01.755130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a5459943-3e12-41ff-acf7-401ed0f2f8f6 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:01.755643 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a5459943-3e12-41ff-acf7-401ed0f2f8f6 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:01.758024 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a5459943-3e12-41ff-acf7-401ed0f2f8f6 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:01.758527 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a5459943-3e12-41ff-acf7-401ed0f2f8f6 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:01.780582 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ae1529d6-f7ec-4318-85e5-ef18d9a635d7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:01.780582 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ae1529d6-f7ec-4318-85e5-ef18d9a635d7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:01.787731 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ae1529d6-f7ec-4318-85e5-ef18d9a635d7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:01.788235 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ae1529d6-f7ec-4318-85e5-ef18d9a635d7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:01.789275 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ae1529d6-f7ec-4318-85e5-ef18d9a635d7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:01.789740 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ae1529d6-f7ec-4318-85e5-ef18d9a635d7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:01.842973 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-a5459943-3e12-41ff-acf7-401ed0f2f8f6 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:01.861087 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-a5459943-3e12-41ff-acf7-401ed0f2f8f6 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1187 microversion: 2.1 time: 0.119537 May 10 03:21:01.861087 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 145/300] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:01 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1187 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:01.938392 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ae1529d6-f7ec-4318-85e5-ef18d9a635d7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:01.947607 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ae1529d6-f7ec-4318-85e5-ef18d9a635d7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.175354 May 10 03:21:01.948288 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 156/301] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:01 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:21:02.329004 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-5cc4cbd2-b539-4c9a-9afa-7d8bb5a6506b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:02.329619 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-5cc4cbd2-b539-4c9a-9afa-7d8bb5a6506b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:02.336540 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5cc4cbd2-b539-4c9a-9afa-7d8bb5a6506b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:02.337000 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5cc4cbd2-b539-4c9a-9afa-7d8bb5a6506b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:02.338038 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5cc4cbd2-b539-4c9a-9afa-7d8bb5a6506b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:02.338487 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5cc4cbd2-b539-4c9a-9afa-7d8bb5a6506b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:02.362959 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-fcda7592-8955-4b72-8d05-62fcbb733329 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:02.363668 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-fcda7592-8955-4b72-8d05-62fcbb733329 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:02.370464 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-fcda7592-8955-4b72-8d05-62fcbb733329 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:02.370996 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-fcda7592-8955-4b72-8d05-62fcbb733329 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:02.371770 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-fcda7592-8955-4b72-8d05-62fcbb733329 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:02.372234 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-fcda7592-8955-4b72-8d05-62fcbb733329 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:02.585450 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-fcda7592-8955-4b72-8d05-62fcbb733329 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:02.595038 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-fcda7592-8955-4b72-8d05-62fcbb733329 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1722 microversion: 2.1 time: 0.236245 May 10 03:21:02.596186 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 157/302] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:02 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:21:02.602203 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-bd28a724-0536-4541-b546-e2dde9f479dc tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:02.603012 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-bd28a724-0536-4541-b546-e2dde9f479dc tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:02.610066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bd28a724-0536-4541-b546-e2dde9f479dc tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:02.610641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bd28a724-0536-4541-b546-e2dde9f479dc tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:02.611426 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bd28a724-0536-4541-b546-e2dde9f479dc tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:02.611864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bd28a724-0536-4541-b546-e2dde9f479dc tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:02.625158 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5cc4cbd2-b539-4c9a-9afa-7d8bb5a6506b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:02.633009 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-5cc4cbd2-b539-4c9a-9afa-7d8bb5a6506b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1367 microversion: 2.1 time: 0.308132 May 10 03:21:02.633582 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 146/303] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:02 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:02.775875 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-bd28a724-0536-4541-b546-e2dde9f479dc tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:02.784570 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-bd28a724-0536-4541-b546-e2dde9f479dc tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:02.786071 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-bd28a724-0536-4541-b546-e2dde9f479dc tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:02.791078 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-bd28a724-0536-4541-b546-e2dde9f479dc tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1722 microversion: 2.20 time: 0.189964 May 10 03:21:02.791078 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 158/304] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:02 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:02.877390 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-7e95ff48-2bf1-49b2-a662-fb6b9f86a4df tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:02.878586 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-7e95ff48-2bf1-49b2-a662-fb6b9f86a4df tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:02.885931 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7e95ff48-2bf1-49b2-a662-fb6b9f86a4df tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:02.886481 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7e95ff48-2bf1-49b2-a662-fb6b9f86a4df tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:02.887357 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7e95ff48-2bf1-49b2-a662-fb6b9f86a4df tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:02.887882 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7e95ff48-2bf1-49b2-a662-fb6b9f86a4df tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:02.964732 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-975d0f9e-fc36-495e-b1a8-92a28bfd9677 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:02.965504 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-975d0f9e-fc36-495e-b1a8-92a28bfd9677 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:02.967834 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-7e95ff48-2bf1-49b2-a662-fb6b9f86a4df tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:02.977177 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-7e95ff48-2bf1-49b2-a662-fb6b9f86a4df tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1187 microversion: 2.1 time: 0.103626 May 10 03:21:02.978165 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 147/305] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:02 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1187 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:02.999529 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-975d0f9e-fc36-495e-b1a8-92a28bfd9677 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:03.003525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-975d0f9e-fc36-495e-b1a8-92a28bfd9677 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:03.004699 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-975d0f9e-fc36-495e-b1a8-92a28bfd9677 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:03.007660 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-975d0f9e-fc36-495e-b1a8-92a28bfd9677 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:03.164882 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-975d0f9e-fc36-495e-b1a8-92a28bfd9677 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:03.173082 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-975d0f9e-fc36-495e-b1a8-92a28bfd9677 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.212346 May 10 03:21:03.176041 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 159/306] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:02 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:03.613230 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-cc504230-9220-4bbe-9781-7162f710cee4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:03.613959 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-cc504230-9220-4bbe-9781-7162f710cee4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:03.624269 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cc504230-9220-4bbe-9781-7162f710cee4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:03.624269 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cc504230-9220-4bbe-9781-7162f710cee4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:03.624269 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cc504230-9220-4bbe-9781-7162f710cee4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:03.624269 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cc504230-9220-4bbe-9781-7162f710cee4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:03.651309 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-857a7a4c-a60d-4690-9380-ad563eb22fd6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:03.652159 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-857a7a4c-a60d-4690-9380-ad563eb22fd6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:03.658496 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-857a7a4c-a60d-4690-9380-ad563eb22fd6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:03.658939 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-857a7a4c-a60d-4690-9380-ad563eb22fd6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:03.660392 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-857a7a4c-a60d-4690-9380-ad563eb22fd6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:03.660392 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-857a7a4c-a60d-4690-9380-ad563eb22fd6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:03.843820 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-cc504230-9220-4bbe-9781-7162f710cee4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:03.854911 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-857a7a4c-a60d-4690-9380-ad563eb22fd6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:03.855857 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-cc504230-9220-4bbe-9781-7162f710cee4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1699 microversion: 2.1 time: 0.246697 May 10 03:21:03.857648 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 148/307] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:03 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1699 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:03.863395 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-f24c4a6b-01dd-4dd1-9a39-07ac8efdd9c5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:03.864244 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-f24c4a6b-01dd-4dd1-9a39-07ac8efdd9c5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:03.871087 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f24c4a6b-01dd-4dd1-9a39-07ac8efdd9c5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:03.871532 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f24c4a6b-01dd-4dd1-9a39-07ac8efdd9c5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:03.872553 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f24c4a6b-01dd-4dd1-9a39-07ac8efdd9c5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:03.873148 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f24c4a6b-01dd-4dd1-9a39-07ac8efdd9c5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:03.875060 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-857a7a4c-a60d-4690-9380-ad563eb22fd6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1367 microversion: 2.1 time: 0.228855 May 10 03:21:03.875973 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 160/308] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:03 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:21:03.882244 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-0ea36af8-0722-414f-9716-95eaed22199f tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:03.891558 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0ea36af8-0722-414f-9716-95eaed22199f tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:03.892311 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0ea36af8-0722-414f-9716-95eaed22199f tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:03.918784 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-0ea36af8-0722-414f-9716-95eaed22199f tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Going to try to start instance {{(pid=117399) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 03:21:04.033444 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-f24c4a6b-01dd-4dd1-9a39-07ac8efdd9c5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:04.042623 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-f24c4a6b-01dd-4dd1-9a39-07ac8efdd9c5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:04.047642 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-f24c4a6b-01dd-4dd1-9a39-07ac8efdd9c5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:04.047642 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-f24c4a6b-01dd-4dd1-9a39-07ac8efdd9c5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1722 microversion: 2.20 time: 0.186554 May 10 03:21:04.047642 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 149/309] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:03 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:04.050276 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-d47ac296-3a7b-42ac-96d0-00353fccd0ae tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:04.051027 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-d47ac296-3a7b-42ac-96d0-00353fccd0ae tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:04.057460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d47ac296-3a7b-42ac-96d0-00353fccd0ae tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:04.057903 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d47ac296-3a7b-42ac-96d0-00353fccd0ae tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:04.058659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d47ac296-3a7b-42ac-96d0-00353fccd0ae tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:04.059090 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d47ac296-3a7b-42ac-96d0-00353fccd0ae tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:04.134505 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-0ea36af8-0722-414f-9716-95eaed22199f tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "POST /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13/action" status: 202 len: 0 microversion: 2.1 time: 0.257198 May 10 03:21:04.135111 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 161/310] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 03:21:03 2022] POST /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:21:04.144228 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ba7b2102-f599-4cb1-8ab5-2a0ec3cee671 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:04.151747 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ba7b2102-f599-4cb1-8ab5-2a0ec3cee671 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:04.164454 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ba7b2102-f599-4cb1-8ab5-2a0ec3cee671 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:04.165182 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ba7b2102-f599-4cb1-8ab5-2a0ec3cee671 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:04.170964 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ba7b2102-f599-4cb1-8ab5-2a0ec3cee671 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:04.170964 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ba7b2102-f599-4cb1-8ab5-2a0ec3cee671 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:04.274971 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-d47ac296-3a7b-42ac-96d0-00353fccd0ae tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:04.290147 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-d47ac296-3a7b-42ac-96d0-00353fccd0ae tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1272 microversion: 2.1 time: 0.240520 May 10 03:21:04.302666 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 150/311] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:04 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1272 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:04.306786 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-28b1daa4-4f25-4766-8d0a-6b2ea42da7a0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:04.307404 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-28b1daa4-4f25-4766-8d0a-6b2ea42da7a0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:04.314128 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-28b1daa4-4f25-4766-8d0a-6b2ea42da7a0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:04.314577 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-28b1daa4-4f25-4766-8d0a-6b2ea42da7a0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:04.315364 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-28b1daa4-4f25-4766-8d0a-6b2ea42da7a0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:04.315796 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-28b1daa4-4f25-4766-8d0a-6b2ea42da7a0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:04.409307 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ba7b2102-f599-4cb1-8ab5-2a0ec3cee671 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:04.418954 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ba7b2102-f599-4cb1-8ab5-2a0ec3cee671 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1708 microversion: 2.1 time: 0.279183 May 10 03:21:04.419850 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 162/312] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:04 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1708 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:21:04.493843 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-28b1daa4-4f25-4766-8d0a-6b2ea42da7a0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:04.505282 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-28b1daa4-4f25-4766-8d0a-6b2ea42da7a0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.203430 May 10 03:21:04.506841 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 151/313] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:04 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:04.892606 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-6a5d5d03-a83c-4571-9fda-0dcd9a99d040 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:04.893211 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-6a5d5d03-a83c-4571-9fda-0dcd9a99d040 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:04.900073 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6a5d5d03-a83c-4571-9fda-0dcd9a99d040 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:04.900926 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6a5d5d03-a83c-4571-9fda-0dcd9a99d040 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:04.901783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6a5d5d03-a83c-4571-9fda-0dcd9a99d040 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:04.902435 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6a5d5d03-a83c-4571-9fda-0dcd9a99d040 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:05.064343 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-32bee331-e23e-4393-ba64-2a9da78247a6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:05.064947 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-32bee331-e23e-4393-ba64-2a9da78247a6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:05.067973 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-6a5d5d03-a83c-4571-9fda-0dcd9a99d040 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:05.073074 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-32bee331-e23e-4393-ba64-2a9da78247a6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:05.076956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-32bee331-e23e-4393-ba64-2a9da78247a6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:05.076956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-32bee331-e23e-4393-ba64-2a9da78247a6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:05.076956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-32bee331-e23e-4393-ba64-2a9da78247a6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:05.077379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-6a5d5d03-a83c-4571-9fda-0dcd9a99d040 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1367 microversion: 2.1 time: 0.188436 May 10 03:21:05.080147 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 163/314] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:04 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:05.216890 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-32bee331-e23e-4393-ba64-2a9da78247a6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:05.224678 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-32bee331-e23e-4393-ba64-2a9da78247a6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:05.226744 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-32bee331-e23e-4393-ba64-2a9da78247a6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:05.227986 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-32bee331-e23e-4393-ba64-2a9da78247a6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1722 microversion: 2.20 time: 0.167626 May 10 03:21:05.228642 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 152/315] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:05 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:21:05.322221 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-181775bd-fd12-4e00-8601-e00dfba0cbfb tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:05.322221 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-181775bd-fd12-4e00-8601-e00dfba0cbfb tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:05.328524 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-181775bd-fd12-4e00-8601-e00dfba0cbfb tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:05.328944 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-181775bd-fd12-4e00-8601-e00dfba0cbfb tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:05.329766 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-181775bd-fd12-4e00-8601-e00dfba0cbfb tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:05.330210 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-181775bd-fd12-4e00-8601-e00dfba0cbfb tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:05.437068 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-73a9cf3b-c698-4d85-8ee3-187a07d6ff04 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:05.437937 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-73a9cf3b-c698-4d85-8ee3-187a07d6ff04 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:05.453669 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-73a9cf3b-c698-4d85-8ee3-187a07d6ff04 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:05.454418 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-73a9cf3b-c698-4d85-8ee3-187a07d6ff04 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:05.467354 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-73a9cf3b-c698-4d85-8ee3-187a07d6ff04 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:05.467907 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-73a9cf3b-c698-4d85-8ee3-187a07d6ff04 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:05.486776 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-181775bd-fd12-4e00-8601-e00dfba0cbfb tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:05.494734 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-181775bd-fd12-4e00-8601-e00dfba0cbfb tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1260 microversion: 2.1 time: 0.185451 May 10 03:21:05.505060 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 164/316] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:05 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:05.528915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-09501947-69a1-475d-8556-9daadf7b436e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:05.529531 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-09501947-69a1-475d-8556-9daadf7b436e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:05.537047 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-09501947-69a1-475d-8556-9daadf7b436e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:05.537541 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-09501947-69a1-475d-8556-9daadf7b436e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:05.538351 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-09501947-69a1-475d-8556-9daadf7b436e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:05.538797 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-09501947-69a1-475d-8556-9daadf7b436e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:05.748370 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-73a9cf3b-c698-4d85-8ee3-187a07d6ff04 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:05.757085 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-73a9cf3b-c698-4d85-8ee3-187a07d6ff04 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1708 microversion: 2.1 time: 0.323861 May 10 03:21:05.758939 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 153/317] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:05 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1708 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:05.775449 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-09501947-69a1-475d-8556-9daadf7b436e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:05.783950 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-09501947-69a1-475d-8556-9daadf7b436e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.259688 May 10 03:21:05.784550 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 165/318] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:05 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:05.864818 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-1145b5fd-8032-4ce9-aa08-f441abcfacb1 req-f7297e8b-f50f-4411-b0da-bcf6fe1b3baf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8", "tag": "d0c4a220-cc8c-4389-8209-eac5e6740986"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:05.873758 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-1145b5fd-8032-4ce9-aa08-f441abcfacb1 req-f7297e8b-f50f-4411-b0da-bcf6fe1b3baf service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:05.874524 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-1145b5fd-8032-4ce9-aa08-f441abcfacb1 req-f7297e8b-f50f-4411-b0da-bcf6fe1b3baf service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:05.886171 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-1145b5fd-8032-4ce9-aa08-f441abcfacb1 req-f7297e8b-f50f-4411-b0da-bcf6fe1b3baf service nova] Creating event network-changed:d0c4a220-cc8c-4389-8209-eac5e6740986 for instance 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 on hv-cinder-83009 May 10 03:21:05.891247 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-1145b5fd-8032-4ce9-aa08-f441abcfacb1 req-f7297e8b-f50f-4411-b0da-bcf6fe1b3baf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030292 May 10 03:21:05.892445 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 154/319] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:06.096216 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-90b40ba9-79ab-45d2-9fff-ede949dd47a4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:06.096802 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-90b40ba9-79ab-45d2-9fff-ede949dd47a4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:06.103946 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-90b40ba9-79ab-45d2-9fff-ede949dd47a4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:06.104432 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-90b40ba9-79ab-45d2-9fff-ede949dd47a4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:06.105268 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-90b40ba9-79ab-45d2-9fff-ede949dd47a4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:06.105644 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-90b40ba9-79ab-45d2-9fff-ede949dd47a4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:06.238972 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-90b40ba9-79ab-45d2-9fff-ede949dd47a4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:06.247259 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-565bd555-89d5-4a07-881d-f73e7117f1eb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:06.248124 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-565bd555-89d5-4a07-881d-f73e7117f1eb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:06.249075 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-90b40ba9-79ab-45d2-9fff-ede949dd47a4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1367 microversion: 2.1 time: 0.156855 May 10 03:21:06.249992 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 166/320] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:06 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:06.254431 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-565bd555-89d5-4a07-881d-f73e7117f1eb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:06.254883 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-565bd555-89d5-4a07-881d-f73e7117f1eb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:06.258101 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-565bd555-89d5-4a07-881d-f73e7117f1eb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:06.258101 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-565bd555-89d5-4a07-881d-f73e7117f1eb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:06.393326 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-565bd555-89d5-4a07-881d-f73e7117f1eb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:06.402328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-565bd555-89d5-4a07-881d-f73e7117f1eb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:06.403842 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-565bd555-89d5-4a07-881d-f73e7117f1eb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:06.405070 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-565bd555-89d5-4a07-881d-f73e7117f1eb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1722 microversion: 2.20 time: 0.162642 May 10 03:21:06.405630 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 155/321] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:06 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:21:06.512391 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-18aaa8e6-2f44-4dd4-a227-5e0439278980 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:06.512994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-18aaa8e6-2f44-4dd4-a227-5e0439278980 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:06.525035 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-18aaa8e6-2f44-4dd4-a227-5e0439278980 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:06.525531 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-18aaa8e6-2f44-4dd4-a227-5e0439278980 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:06.526460 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-18aaa8e6-2f44-4dd4-a227-5e0439278980 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:06.527004 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-18aaa8e6-2f44-4dd4-a227-5e0439278980 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:06.757041 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-18aaa8e6-2f44-4dd4-a227-5e0439278980 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:06.768641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-18aaa8e6-2f44-4dd4-a227-5e0439278980 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1260 microversion: 2.1 time: 0.260190 May 10 03:21:06.769842 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 167/322] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:06 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1260 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:06.775600 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-325f2050-9070-4ae6-a745-8b7c7e8d853e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:06.776432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-325f2050-9070-4ae6-a745-8b7c7e8d853e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:06.783814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-325f2050-9070-4ae6-a745-8b7c7e8d853e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:06.784532 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-325f2050-9070-4ae6-a745-8b7c7e8d853e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:06.785591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-325f2050-9070-4ae6-a745-8b7c7e8d853e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:06.786189 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-325f2050-9070-4ae6-a745-8b7c7e8d853e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:06.801929 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a6c5e60d-37a9-4556-ba57-434bbd68d3e7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:06.802535 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-a6c5e60d-37a9-4556-ba57-434bbd68d3e7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:06.808943 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a6c5e60d-37a9-4556-ba57-434bbd68d3e7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:06.809607 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a6c5e60d-37a9-4556-ba57-434bbd68d3e7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:06.810854 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a6c5e60d-37a9-4556-ba57-434bbd68d3e7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:06.811503 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a6c5e60d-37a9-4556-ba57-434bbd68d3e7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:07.096045 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-a6c5e60d-37a9-4556-ba57-434bbd68d3e7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:07.104733 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-a6c5e60d-37a9-4556-ba57-434bbd68d3e7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.306943 May 10 03:21:07.114475 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-325f2050-9070-4ae6-a745-8b7c7e8d853e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:07.115192 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 168/323] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:06 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:21:07.122904 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-325f2050-9070-4ae6-a745-8b7c7e8d853e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1708 microversion: 2.1 time: 0.351691 May 10 03:21:07.128922 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 156/324] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:06 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1708 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:07.181264 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-5fa7ff34-7c78-41ab-9f37-e54358c42805 req-7ee3baa7-7c38-4636-a2dc-3189c4fbe469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25e932f1-fc8d-4515-b33f-e1ba788e850b", "name": "network-vif-plugged", "status": "completed", "tag": "e00eeae9-db9b-46b3-b858-0190082d908f"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:07.189992 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-5fa7ff34-7c78-41ab-9f37-e54358c42805 req-7ee3baa7-7c38-4636-a2dc-3189c4fbe469 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:07.190506 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-5fa7ff34-7c78-41ab-9f37-e54358c42805 req-7ee3baa7-7c38-4636-a2dc-3189c4fbe469 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:07.202575 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-5fa7ff34-7c78-41ab-9f37-e54358c42805 req-7ee3baa7-7c38-4636-a2dc-3189c4fbe469 service nova] Creating event network-vif-plugged:e00eeae9-db9b-46b3-b858-0190082d908f for instance 25e932f1-fc8d-4515-b33f-e1ba788e850b on hv-cinder-83009 May 10 03:21:07.207763 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-5fa7ff34-7c78-41ab-9f37-e54358c42805 req-7ee3baa7-7c38-4636-a2dc-3189c4fbe469 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030591 May 10 03:21:07.208508 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 169/325] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:07.272946 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-d05888c6-61c2-46c5-9e79-fd61c56536fc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:07.273558 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-d05888c6-61c2-46c5-9e79-fd61c56536fc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:07.280508 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d05888c6-61c2-46c5-9e79-fd61c56536fc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:07.281145 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d05888c6-61c2-46c5-9e79-fd61c56536fc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:07.282171 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d05888c6-61c2-46c5-9e79-fd61c56536fc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:07.282768 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d05888c6-61c2-46c5-9e79-fd61c56536fc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:07.424761 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-35cc4577-d5ed-4a19-927c-dd64dd6331a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:07.425695 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-35cc4577-d5ed-4a19-927c-dd64dd6331a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:07.433374 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-35cc4577-d5ed-4a19-927c-dd64dd6331a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:07.439089 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-35cc4577-d5ed-4a19-927c-dd64dd6331a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:07.439089 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-35cc4577-d5ed-4a19-927c-dd64dd6331a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:07.439089 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-35cc4577-d5ed-4a19-927c-dd64dd6331a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:07.510767 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-d05888c6-61c2-46c5-9e79-fd61c56536fc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:07.536443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-d05888c6-61c2-46c5-9e79-fd61c56536fc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1367 microversion: 2.1 time: 0.267430 May 10 03:21:07.539236 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 157/326] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:07 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:07.656145 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-35cc4577-d5ed-4a19-927c-dd64dd6331a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:07.670925 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-35cc4577-d5ed-4a19-927c-dd64dd6331a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:07.672455 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-35cc4577-d5ed-4a19-927c-dd64dd6331a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:07.674266 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-35cc4577-d5ed-4a19-927c-dd64dd6331a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1722 microversion: 2.20 time: 0.253530 May 10 03:21:07.675006 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 170/327] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:07 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:21:07.786989 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-0989b51a-f727-4a60-b329-75c8fb6c33be tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:07.788735 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-0989b51a-f727-4a60-b329-75c8fb6c33be tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:07.795419 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0989b51a-f727-4a60-b329-75c8fb6c33be tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:07.795879 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0989b51a-f727-4a60-b329-75c8fb6c33be tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:07.796747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0989b51a-f727-4a60-b329-75c8fb6c33be tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:07.797190 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0989b51a-f727-4a60-b329-75c8fb6c33be tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:08.022317 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-0989b51a-f727-4a60-b329-75c8fb6c33be tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:08.030150 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-0989b51a-f727-4a60-b329-75c8fb6c33be tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1260 microversion: 2.1 time: 0.247297 May 10 03:21:08.030883 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 158/328] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:07 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:08.122172 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-8c16eeb3-0b22-4368-8778-9e53269f07f4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:08.123394 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8c16eeb3-0b22-4368-8778-9e53269f07f4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:08.133402 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8c16eeb3-0b22-4368-8778-9e53269f07f4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:08.133854 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8c16eeb3-0b22-4368-8778-9e53269f07f4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:08.134648 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8c16eeb3-0b22-4368-8778-9e53269f07f4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:08.135502 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8c16eeb3-0b22-4368-8778-9e53269f07f4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:08.139724 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-97e14e99-bc61-41bf-9385-914bd05d4024 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:08.140387 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-97e14e99-bc61-41bf-9385-914bd05d4024 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:08.151632 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-97e14e99-bc61-41bf-9385-914bd05d4024 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:08.152297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-97e14e99-bc61-41bf-9385-914bd05d4024 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:08.153263 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-97e14e99-bc61-41bf-9385-914bd05d4024 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:08.157780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-97e14e99-bc61-41bf-9385-914bd05d4024 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:08.770242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8c16eeb3-0b22-4368-8778-9e53269f07f4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:08.778161 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-8c16eeb3-0b22-4368-8778-9e53269f07f4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.659704 May 10 03:21:08.778751 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 171/329] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:08 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:08.783730 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-3c5a5e99-29b6-4925-b98b-6a79ef64c15b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:08.784366 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-3c5a5e99-29b6-4925-b98b-6a79ef64c15b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:08.785601 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-97e14e99-bc61-41bf-9385-914bd05d4024 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:08.797563 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-97e14e99-bc61-41bf-9385-914bd05d4024 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1712 microversion: 2.1 time: 0.661448 May 10 03:21:08.808372 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3c5a5e99-29b6-4925-b98b-6a79ef64c15b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:08.808372 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3c5a5e99-29b6-4925-b98b-6a79ef64c15b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:08.808372 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3c5a5e99-29b6-4925-b98b-6a79ef64c15b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:08.808372 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3c5a5e99-29b6-4925-b98b-6a79ef64c15b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:08.808869 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 159/330] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:08 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1712 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:21:08.817055 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-44f743ed-48b1-419e-b8f9-ad6b86fab579 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:08.817895 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-44f743ed-48b1-419e-b8f9-ad6b86fab579 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:08.825519 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-44f743ed-48b1-419e-b8f9-ad6b86fab579 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:08.826162 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-44f743ed-48b1-419e-b8f9-ad6b86fab579 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:08.827110 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-44f743ed-48b1-419e-b8f9-ad6b86fab579 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:08.827696 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-44f743ed-48b1-419e-b8f9-ad6b86fab579 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:09.122037 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-3c5a5e99-29b6-4925-b98b-6a79ef64c15b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:09.130641 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-44f743ed-48b1-419e-b8f9-ad6b86fab579 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:09.136386 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-3c5a5e99-29b6-4925-b98b-6a79ef64c15b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1367 microversion: 2.1 time: 0.356392 May 10 03:21:09.138103 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 172/331] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:08 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1367 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:09.142843 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-fce9955f-be4d-406f-a2be-5137eda5a8a6 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:09.148719 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-44f743ed-48b1-419e-b8f9-ad6b86fab579 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:09.150214 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-44f743ed-48b1-419e-b8f9-ad6b86fab579 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:09.151378 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-44f743ed-48b1-419e-b8f9-ad6b86fab579 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1743 microversion: 2.20 time: 0.338319 May 10 03:21:09.152387 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-fce9955f-be4d-406f-a2be-5137eda5a8a6 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:09.166541 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 160/332] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:08 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1743 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:09.166747 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-fce9955f-be4d-406f-a2be-5137eda5a8a6 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:09.166747 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-fce9955f-be4d-406f-a2be-5137eda5a8a6 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:09.166747 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-fce9955f-be4d-406f-a2be-5137eda5a8a6 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:09.166747 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-fce9955f-be4d-406f-a2be-5137eda5a8a6 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:09.342063 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-fce9955f-be4d-406f-a2be-5137eda5a8a6 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:09.349439 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-fce9955f-be4d-406f-a2be-5137eda5a8a6 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1260 microversion: 2.1 time: 0.210161 May 10 03:21:09.350035 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 173/333] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:09 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:09.802828 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-3dad9a4b-a9aa-4add-b10c-2d0593d92051 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:09.802828 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-3dad9a4b-a9aa-4add-b10c-2d0593d92051 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:09.803509 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3dad9a4b-a9aa-4add-b10c-2d0593d92051 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:09.804024 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3dad9a4b-a9aa-4add-b10c-2d0593d92051 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:09.804878 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3dad9a4b-a9aa-4add-b10c-2d0593d92051 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:09.805360 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3dad9a4b-a9aa-4add-b10c-2d0593d92051 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:10.003057 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-3dad9a4b-a9aa-4add-b10c-2d0593d92051 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:10.011211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-3dad9a4b-a9aa-4add-b10c-2d0593d92051 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.219065 May 10 03:21:10.011935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 161/334] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:09 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:10.154234 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-462d9bd4-c5c2-497a-88f9-2e58374cba0f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:10.154946 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-462d9bd4-c5c2-497a-88f9-2e58374cba0f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:10.161664 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-462d9bd4-c5c2-497a-88f9-2e58374cba0f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:10.162201 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-462d9bd4-c5c2-497a-88f9-2e58374cba0f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:10.163053 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-462d9bd4-c5c2-497a-88f9-2e58374cba0f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:10.163714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-462d9bd4-c5c2-497a-88f9-2e58374cba0f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:10.176766 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-9180eea8-64dd-44ea-8219-6a810a8dbb33 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:10.177947 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-9180eea8-64dd-44ea-8219-6a810a8dbb33 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:10.187019 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9180eea8-64dd-44ea-8219-6a810a8dbb33 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:10.187527 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9180eea8-64dd-44ea-8219-6a810a8dbb33 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:10.188735 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9180eea8-64dd-44ea-8219-6a810a8dbb33 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:10.188936 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9180eea8-64dd-44ea-8219-6a810a8dbb33 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:10.425590 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-462d9bd4-c5c2-497a-88f9-2e58374cba0f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:10.435524 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-462d9bd4-c5c2-497a-88f9-2e58374cba0f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1367 microversion: 2.1 time: 0.285097 May 10 03:21:10.445823 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 174/335] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:10 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:10.449825 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-9180eea8-64dd-44ea-8219-6a810a8dbb33 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:10.450770 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-f33f6ef0-5899-45aa-9962-d9f5395bdf09 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:10.451674 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-f33f6ef0-5899-45aa-9962-d9f5395bdf09 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:10.458838 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f33f6ef0-5899-45aa-9962-d9f5395bdf09 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:10.459526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f33f6ef0-5899-45aa-9962-d9f5395bdf09 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:10.461008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-9180eea8-64dd-44ea-8219-6a810a8dbb33 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:10.462501 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-9180eea8-64dd-44ea-8219-6a810a8dbb33 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:10.463198 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f33f6ef0-5899-45aa-9962-d9f5395bdf09 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:10.463979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f33f6ef0-5899-45aa-9962-d9f5395bdf09 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:10.464189 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-9180eea8-64dd-44ea-8219-6a810a8dbb33 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1743 microversion: 2.20 time: 0.292123 May 10 03:21:10.464762 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 162/336] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:10 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1743 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:10.723019 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-f33f6ef0-5899-45aa-9962-d9f5395bdf09 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:10.738739 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-f33f6ef0-5899-45aa-9962-d9f5395bdf09 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1260 microversion: 2.1 time: 0.296619 May 10 03:21:10.739591 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 175/337] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:10 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1260 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:11.032554 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-5ad555b4-539b-4708-8b0c-312ed9bf1580 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:11.033768 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-5ad555b4-539b-4708-8b0c-312ed9bf1580 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:11.043410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5ad555b4-539b-4708-8b0c-312ed9bf1580 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:11.044937 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5ad555b4-539b-4708-8b0c-312ed9bf1580 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:11.046471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5ad555b4-539b-4708-8b0c-312ed9bf1580 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:11.047098 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5ad555b4-539b-4708-8b0c-312ed9bf1580 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:11.316377 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5ad555b4-539b-4708-8b0c-312ed9bf1580 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:11.325926 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-5ad555b4-539b-4708-8b0c-312ed9bf1580 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1503 microversion: 2.1 time: 0.301085 May 10 03:21:11.345500 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 163/338] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:11 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1503 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:11.352882 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-6912caa4-c5e1-43e8-999c-b1dab5d09eb9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0d13936-a98d-40bb-8dfa-5d817f0dd597"}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:11.354018 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-6912caa4-c5e1-43e8-999c-b1dab5d09eb9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:11.361711 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6912caa4-c5e1-43e8-999c-b1dab5d09eb9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:11.362170 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6912caa4-c5e1-43e8-999c-b1dab5d09eb9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:11.362965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6912caa4-c5e1-43e8-999c-b1dab5d09eb9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:11.363404 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6912caa4-c5e1-43e8-999c-b1dab5d09eb9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:11.393563 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-6912caa4-c5e1-43e8-999c-b1dab5d09eb9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] HTTP exception thrown: Cannot 'attach_volume' instance b289186d-a316-4521-92a0-4e13ae9b0083 while it is in vm_state rescued May 10 03:21:11.395536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-6912caa4-c5e1-43e8-999c-b1dab5d09eb9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Request method failure captured: May 10 03:21:11.395536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: POST /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083/os-volume_attachments HTTP/1.1 May 10 03:21:11.395536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:21:11.395536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:21:11.395536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:21:11.395536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 74 May 10 03:21:11.395536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:21:11.395536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:21:11.395536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:21:11.395536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:21:11.395536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedm4YBo_VeiW-S1UxjlvvKNx7u6jWbPbvvm0pYOm5amQBwu7q0C7Rd8nGSaIclBMXEqqaxCizBVj7NePFJ1eCV8CTM1okztCGz5tsrL80ntHdSO2lpXeHCYcWrqg_AqJQDp6ALaVfEt1ayCvEgCMFkenfpQm-YCKlUpXTGJxCi7gX6Y May 10 03:21:11.395536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:21:11.395536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:21:11.395536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:21:11.395536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:21:11.395536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:21:11.395536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:21:11.395536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: d8e319a149db44fb8bb71f3066c82956 May 10 03:21:11.395536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1946563297 May 10 03:21:11.395536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:21:11.395536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:21:11.400081 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d8e319a149db44fb8bb71f3066c82956", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8e319a149db44fb8bb71f3066c82956"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8e319a149db44fb8bb71f3066c82956"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d8e319a149db44fb8bb71f3066c82956"}]}] May 10 03:21:11.400081 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1946563297 May 10 03:21:11.400081 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: d8e319a149db44fb8bb71f3066c82956 May 10 03:21:11.400081 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1946563297 May 10 03:21:11.400081 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-ServerRescueNegativeTestJSON-1946563297-project May 10 03:21:11.400081 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:21:11.400081 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:21:11.400081 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: e309fb66a98b407d8b7533207e6a6dfc May 10 03:21:11.400081 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1946563297-project May 10 03:21:11.400081 dv-cinder-830094-4-smb devstack@n-api.service[117399]: May 10 03:21:11.400081 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {"volumeAttachment": {"volumeId": "a0d13936-a98d-40bb-8dfa-5d817f0dd597"}} May 10 03:21:11.400081 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: > May 10 03:21:11.401139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Cannot 'attach_volume' instance b289186d-a316-4521-92a0-4e13ae9b0083 while it is in vm_state rescued May 10 03:21:11.401139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'server_id': 'b289186d-a316-4521-92a0-4e13ae9b0083', 'body': {'volumeAttachment': {'volumeId': 'a0d13936-a98d-40bb-8dfa-5d817f0dd597'}}} May 10 03:21:11.401139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:21:11.401139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:11.401139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 03:21:11.401139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 03:21:11.401139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 03:21:11.401139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 03:21:11.401139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 03:21:11.401139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 03:21:11.401139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b289186d-a316-4521-92a0-4e13ae9b0083 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 10 03:21:11.401139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:21:11.401139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:11.401139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:21:11.401139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:11.401139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:11.401139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:11.401139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:21:11.401139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:21:11.402499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:21:11.402499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:21:11.402499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 03:21:11.402499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:21:11.402499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 03:21:11.402499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:21:11.402499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 03:21:11.402499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:21:11.402499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 10 03:21:11.402499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 03:21:11.402499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 03:21:11.402499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 03:21:11.402499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b289186d-a316-4521-92a0-4e13ae9b0083 while it is in vm_state rescued May 10 03:21:11.402499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:21:11.402499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:21:11.402499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:21:11.402499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:21:11.402499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:21:11.402499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:21:11.403775 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:21:11.403775 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:21:11.403775 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b289186d-a316-4521-92a0-4e13ae9b0083 while it is in vm_state rescued May 10 03:21:11.403775 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:21:11.403775 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-6912caa4-c5e1-43e8-999c-b1dab5d09eb9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Returning 409 to user: Cannot 'attach_volume' instance b289186d-a316-4521-92a0-4e13ae9b0083 while it is in vm_state rescued {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:21:11.403775 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-6912caa4-c5e1-43e8-999c-b1dab5d09eb9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "POST /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050103 May 10 03:21:11.403775 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 176/339] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 03:21:11 2022] POST /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 03:21:11.411759 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-bb0a3bba-7bc5-41ec-ab44-f2e3f003d511 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:11.415235 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-bb0a3bba-7bc5-41ec-ab44-f2e3f003d511 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:11.446257 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bb0a3bba-7bc5-41ec-ab44-f2e3f003d511 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:11.447384 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bb0a3bba-7bc5-41ec-ab44-f2e3f003d511 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:11.460563 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-9b7dc42c-757f-41cb-872f-5fbdbab7dd29 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:11.461457 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-9b7dc42c-757f-41cb-872f-5fbdbab7dd29 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:11.465170 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bb0a3bba-7bc5-41ec-ab44-f2e3f003d511 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:11.466034 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bb0a3bba-7bc5-41ec-ab44-f2e3f003d511 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:11.472903 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9b7dc42c-757f-41cb-872f-5fbdbab7dd29 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:11.473366 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9b7dc42c-757f-41cb-872f-5fbdbab7dd29 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:11.474168 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9b7dc42c-757f-41cb-872f-5fbdbab7dd29 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:11.474652 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9b7dc42c-757f-41cb-872f-5fbdbab7dd29 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:11.763245 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-9b7dc42c-757f-41cb-872f-5fbdbab7dd29 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:11.772104 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-9b7dc42c-757f-41cb-872f-5fbdbab7dd29 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1367 microversion: 2.1 time: 0.317244 May 10 03:21:11.772762 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 177/340] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:11 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1367 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:21:11.777771 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-bc5e2f34-defb-44b3-99a4-7c666afe5cc4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:11.778611 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-bc5e2f34-defb-44b3-99a4-7c666afe5cc4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:11.785389 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bc5e2f34-defb-44b3-99a4-7c666afe5cc4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:11.786074 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bc5e2f34-defb-44b3-99a4-7c666afe5cc4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:11.787518 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bc5e2f34-defb-44b3-99a4-7c666afe5cc4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:11.796782 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bc5e2f34-defb-44b3-99a4-7c666afe5cc4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:11.801253 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-bb0a3bba-7bc5-41ec-ab44-f2e3f003d511 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "POST /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083/action" status: 202 len: 0 microversion: 2.1 time: 0.395540 May 10 03:21:11.801891 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 164/341] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 03:21:11 2022] POST /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:21:11.812374 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-c590a9d0-039e-45a3-97ae-7ee932fd1ae4 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:11.813541 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-c590a9d0-039e-45a3-97ae-7ee932fd1ae4 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:11.829890 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c590a9d0-039e-45a3-97ae-7ee932fd1ae4 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:11.830652 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c590a9d0-039e-45a3-97ae-7ee932fd1ae4 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:11.831665 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c590a9d0-039e-45a3-97ae-7ee932fd1ae4 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:11.832126 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c590a9d0-039e-45a3-97ae-7ee932fd1ae4 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:12.037754 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-bc5e2f34-defb-44b3-99a4-7c666afe5cc4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:12.048636 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-bc5e2f34-defb-44b3-99a4-7c666afe5cc4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:12.049960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-c590a9d0-039e-45a3-97ae-7ee932fd1ae4 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:12.050415 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-bc5e2f34-defb-44b3-99a4-7c666afe5cc4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:12.051289 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-bc5e2f34-defb-44b3-99a4-7c666afe5cc4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1743 microversion: 2.20 time: 0.277406 May 10 03:21:12.051850 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 178/342] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:11 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1743 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:12.056452 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-243388eb-66a7-4d09-9135-34399c6cf5c2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:12.057031 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-243388eb-66a7-4d09-9135-34399c6cf5c2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:12.063478 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-243388eb-66a7-4d09-9135-34399c6cf5c2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:12.063935 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-243388eb-66a7-4d09-9135-34399c6cf5c2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:12.064915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-243388eb-66a7-4d09-9135-34399c6cf5c2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:12.065360 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-243388eb-66a7-4d09-9135-34399c6cf5c2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:12.068926 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-c590a9d0-039e-45a3-97ae-7ee932fd1ae4 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1260 microversion: 2.1 time: 0.265718 May 10 03:21:12.069626 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 165/343] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:11 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1260 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:12.206336 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-243388eb-66a7-4d09-9135-34399c6cf5c2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:12.214632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-243388eb-66a7-4d09-9135-34399c6cf5c2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1511 microversion: 2.1 time: 0.161558 May 10 03:21:12.215283 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 179/344] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:12 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:12.790611 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-ebaf3930-b5a1-4866-b210-2f171bd9f34b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:12.791331 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-ebaf3930-b5a1-4866-b210-2f171bd9f34b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:12.798560 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ebaf3930-b5a1-4866-b210-2f171bd9f34b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:12.802750 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ebaf3930-b5a1-4866-b210-2f171bd9f34b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:12.802750 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ebaf3930-b5a1-4866-b210-2f171bd9f34b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:12.802750 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ebaf3930-b5a1-4866-b210-2f171bd9f34b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:13.011205 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ebaf3930-b5a1-4866-b210-2f171bd9f34b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:13.018623 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-ebaf3930-b5a1-4866-b210-2f171bd9f34b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1557 microversion: 2.1 time: 0.232904 May 10 03:21:13.019196 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 166/345] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:12 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1557 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:13.035430 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-49a5133e-fe38-455c-ad5b-d93bb2982f28 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:13.035934 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-49a5133e-fe38-455c-ad5b-d93bb2982f28 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:13.042146 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-49a5133e-fe38-455c-ad5b-d93bb2982f28 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:13.042599 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-49a5133e-fe38-455c-ad5b-d93bb2982f28 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:13.043371 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-49a5133e-fe38-455c-ad5b-d93bb2982f28 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:13.043811 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-49a5133e-fe38-455c-ad5b-d93bb2982f28 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:13.069630 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-fb7da1c7-e6f4-472b-838e-fd3ade1718a8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:13.072559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-fb7da1c7-e6f4-472b-838e-fd3ade1718a8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:13.079368 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fb7da1c7-e6f4-472b-838e-fd3ade1718a8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:13.079950 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fb7da1c7-e6f4-472b-838e-fd3ade1718a8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:13.081094 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fb7da1c7-e6f4-472b-838e-fd3ade1718a8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:13.081548 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fb7da1c7-e6f4-472b-838e-fd3ade1718a8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:13.465817 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-49a5133e-fe38-455c-ad5b-d93bb2982f28 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.434284 May 10 03:21:13.466404 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 180/346] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 10 03:21:13 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b/os-interface => generated 284 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:13.493132 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ca8fed5f-91a3-4996-a99e-58fef35b7a3b tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:13.495727 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ca8fed5f-91a3-4996-a99e-58fef35b7a3b tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:13.510164 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ca8fed5f-91a3-4996-a99e-58fef35b7a3b tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:13.511292 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ca8fed5f-91a3-4996-a99e-58fef35b7a3b tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:13.512298 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ca8fed5f-91a3-4996-a99e-58fef35b7a3b tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:13.513717 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ca8fed5f-91a3-4996-a99e-58fef35b7a3b tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:13.554800 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-fb7da1c7-e6f4-472b-838e-fd3ade1718a8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:13.563473 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-fb7da1c7-e6f4-472b-838e-fd3ade1718a8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:13.565457 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-fb7da1c7-e6f4-472b-838e-fd3ade1718a8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:13.567068 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-fb7da1c7-e6f4-472b-838e-fd3ade1718a8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1738 microversion: 2.20 time: 0.501868 May 10 03:21:13.567960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 167/347] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:13 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1738 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:13.573353 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-2801f40e-7abc-4bc3-ab5d-ff070e3dda18 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:13.574255 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-2801f40e-7abc-4bc3-ab5d-ff070e3dda18 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:13.582249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2801f40e-7abc-4bc3-ab5d-ff070e3dda18 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:13.582784 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2801f40e-7abc-4bc3-ab5d-ff070e3dda18 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:13.583646 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2801f40e-7abc-4bc3-ab5d-ff070e3dda18 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:13.584720 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2801f40e-7abc-4bc3-ab5d-ff070e3dda18 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:13.752616 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ca8fed5f-91a3-4996-a99e-58fef35b7a3b tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:13.761596 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ca8fed5f-91a3-4996-a99e-58fef35b7a3b tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1260 microversion: 2.1 time: 0.282537 May 10 03:21:13.762740 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 181/348] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:13 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1260 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:13.767583 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-d283cb4c-29e0-4076-b499-42fca7d3cce1 req-59aa2c70-9966-407d-99d1-0aba00922451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8796004-8adb-4534-a094-c62dfd2a9636", "name": "network-vif-plugged", "status": "completed", "tag": "373a71b7-374a-4584-ad6b-1d09a234ef37"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:13.775857 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-d283cb4c-29e0-4076-b499-42fca7d3cce1 req-59aa2c70-9966-407d-99d1-0aba00922451 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:13.776550 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-d283cb4c-29e0-4076-b499-42fca7d3cce1 req-59aa2c70-9966-407d-99d1-0aba00922451 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:13.790782 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-d283cb4c-29e0-4076-b499-42fca7d3cce1 req-59aa2c70-9966-407d-99d1-0aba00922451 service nova] Creating event network-vif-plugged:373a71b7-374a-4584-ad6b-1d09a234ef37 for instance e8796004-8adb-4534-a094-c62dfd2a9636 on hv-cinder-83009 May 10 03:21:13.795702 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-2801f40e-7abc-4bc3-ab5d-ff070e3dda18 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:13.804279 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-d283cb4c-29e0-4076-b499-42fca7d3cce1 req-59aa2c70-9966-407d-99d1-0aba00922451 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039073 May 10 03:21:13.804755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-2801f40e-7abc-4bc3-ab5d-ff070e3dda18 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1511 microversion: 2.1 time: 0.235286 May 10 03:21:13.805898 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 168/349] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:13 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1511 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:13.806406 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 182/350] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:14.591842 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-be9e6bd0-d954-43e1-beba-fdbe1ada41f4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:14.594171 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-be9e6bd0-d954-43e1-beba-fdbe1ada41f4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:14.605642 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-be9e6bd0-d954-43e1-beba-fdbe1ada41f4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:14.606670 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-be9e6bd0-d954-43e1-beba-fdbe1ada41f4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:14.608914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-be9e6bd0-d954-43e1-beba-fdbe1ada41f4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:14.609582 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-be9e6bd0-d954-43e1-beba-fdbe1ada41f4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:14.770374 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-be9e6bd0-d954-43e1-beba-fdbe1ada41f4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:14.779584 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e1e6c6c1-3b02-4970-9221-3298ba903621 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:14.780303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-e1e6c6c1-3b02-4970-9221-3298ba903621 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:14.787841 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e1e6c6c1-3b02-4970-9221-3298ba903621 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:14.788333 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-be9e6bd0-d954-43e1-beba-fdbe1ada41f4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:14.788686 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e1e6c6c1-3b02-4970-9221-3298ba903621 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:14.789903 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e1e6c6c1-3b02-4970-9221-3298ba903621 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:14.790491 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e1e6c6c1-3b02-4970-9221-3298ba903621 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:14.790686 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-be9e6bd0-d954-43e1-beba-fdbe1ada41f4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:14.792129 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-be9e6bd0-d954-43e1-beba-fdbe1ada41f4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1738 microversion: 2.20 time: 0.206927 May 10 03:21:14.805300 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 169/351] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:14 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:21:14.825823 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-165ba966-d01a-43fe-a4e1-26ee0041dd95 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:14.826476 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-165ba966-d01a-43fe-a4e1-26ee0041dd95 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:14.832548 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-165ba966-d01a-43fe-a4e1-26ee0041dd95 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:14.832995 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-165ba966-d01a-43fe-a4e1-26ee0041dd95 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:14.834007 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-165ba966-d01a-43fe-a4e1-26ee0041dd95 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:14.834618 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-165ba966-d01a-43fe-a4e1-26ee0041dd95 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:15.072100 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-e1e6c6c1-3b02-4970-9221-3298ba903621 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:15.079821 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-e1e6c6c1-3b02-4970-9221-3298ba903621 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1260 microversion: 2.1 time: 0.304764 May 10 03:21:15.080823 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 183/352] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:14 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1260 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:15.125006 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-165ba966-d01a-43fe-a4e1-26ee0041dd95 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:15.137559 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-165ba966-d01a-43fe-a4e1-26ee0041dd95 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1511 microversion: 2.1 time: 0.317931 May 10 03:21:15.138667 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 170/353] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:14 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1511 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:21:15.331742 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-fdff1f26-0c08-4b1e-a363-722d11dbf92d req-7219a523-32d1-4686-85f3-6fc280c9984f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25e932f1-fc8d-4515-b33f-e1ba788e850b", "tag": "e00eeae9-db9b-46b3-b858-0190082d908f"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:15.345906 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-fdff1f26-0c08-4b1e-a363-722d11dbf92d req-7219a523-32d1-4686-85f3-6fc280c9984f service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:15.346350 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-fdff1f26-0c08-4b1e-a363-722d11dbf92d req-7219a523-32d1-4686-85f3-6fc280c9984f service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:15.359749 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-fdff1f26-0c08-4b1e-a363-722d11dbf92d req-7219a523-32d1-4686-85f3-6fc280c9984f service nova] Creating event network-changed:e00eeae9-db9b-46b3-b858-0190082d908f for instance 25e932f1-fc8d-4515-b33f-e1ba788e850b on hv-cinder-83009 May 10 03:21:15.368944 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-fdff1f26-0c08-4b1e-a363-722d11dbf92d req-7219a523-32d1-4686-85f3-6fc280c9984f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045920 May 10 03:21:15.374644 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 184/354] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:15.814812 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-c2f8fbf5-f050-49ae-98f2-9e6e2143faee tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:15.816759 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-c2f8fbf5-f050-49ae-98f2-9e6e2143faee tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:15.828532 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c2f8fbf5-f050-49ae-98f2-9e6e2143faee tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:15.828998 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c2f8fbf5-f050-49ae-98f2-9e6e2143faee tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:15.829810 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c2f8fbf5-f050-49ae-98f2-9e6e2143faee tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:15.830253 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c2f8fbf5-f050-49ae-98f2-9e6e2143faee tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:16.100547 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-86d82d68-ebd0-4ad0-8c82-06e41eb8d703 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:16.101258 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-86d82d68-ebd0-4ad0-8c82-06e41eb8d703 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:16.118457 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-86d82d68-ebd0-4ad0-8c82-06e41eb8d703 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:16.120132 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-86d82d68-ebd0-4ad0-8c82-06e41eb8d703 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:16.122882 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-86d82d68-ebd0-4ad0-8c82-06e41eb8d703 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:16.123515 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-86d82d68-ebd0-4ad0-8c82-06e41eb8d703 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:16.311157 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-c2f8fbf5-f050-49ae-98f2-9e6e2143faee tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:16.329859 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-c2f8fbf5-f050-49ae-98f2-9e6e2143faee tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:16.334840 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-c2f8fbf5-f050-49ae-98f2-9e6e2143faee tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:16.342007 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-c2f8fbf5-f050-49ae-98f2-9e6e2143faee tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1738 microversion: 2.20 time: 0.532939 May 10 03:21:16.346891 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 171/355] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:15 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1738 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:16.366974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-eed5344d-6f3b-4e04-8666-2e1ec45d5b9d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:16.369854 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-eed5344d-6f3b-4e04-8666-2e1ec45d5b9d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:16.390490 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-eed5344d-6f3b-4e04-8666-2e1ec45d5b9d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:16.391274 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-eed5344d-6f3b-4e04-8666-2e1ec45d5b9d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:16.392331 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-eed5344d-6f3b-4e04-8666-2e1ec45d5b9d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:16.393418 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-eed5344d-6f3b-4e04-8666-2e1ec45d5b9d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:16.557138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-86d82d68-ebd0-4ad0-8c82-06e41eb8d703 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:16.573164 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-86d82d68-ebd0-4ad0-8c82-06e41eb8d703 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1260 microversion: 2.1 time: 0.478948 May 10 03:21:16.574566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 185/356] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:16 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1260 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:16.908666 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-eed5344d-6f3b-4e04-8666-2e1ec45d5b9d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:16.914253 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-76d4b207-b226-4503-87ee-f25cb9e9d981 req-96820319-28ff-4870-b781-7e321a204258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8", "name": "network-vif-plugged", "status": "completed", "tag": "d0c4a220-cc8c-4389-8209-eac5e6740986"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:16.935992 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-eed5344d-6f3b-4e04-8666-2e1ec45d5b9d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1517 microversion: 2.1 time: 0.577725 May 10 03:21:16.935992 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 172/357] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:16 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1517 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:16.954410 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-76d4b207-b226-4503-87ee-f25cb9e9d981 req-96820319-28ff-4870-b781-7e321a204258 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:16.957845 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-76d4b207-b226-4503-87ee-f25cb9e9d981 req-96820319-28ff-4870-b781-7e321a204258 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:16.985253 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-76d4b207-b226-4503-87ee-f25cb9e9d981 req-96820319-28ff-4870-b781-7e321a204258 service nova] Creating event network-vif-plugged:d0c4a220-cc8c-4389-8209-eac5e6740986 for instance 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 on hv-cinder-83009 May 10 03:21:16.996628 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-76d4b207-b226-4503-87ee-f25cb9e9d981 req-96820319-28ff-4870-b781-7e321a204258 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100270 May 10 03:21:16.999634 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 186/358] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:17.372447 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-143cef3e-db09-40d3-81ee-20fe99914a71 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:17.373032 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-143cef3e-db09-40d3-81ee-20fe99914a71 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:17.391279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-143cef3e-db09-40d3-81ee-20fe99914a71 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:17.392110 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-143cef3e-db09-40d3-81ee-20fe99914a71 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:17.393215 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-143cef3e-db09-40d3-81ee-20fe99914a71 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:17.393799 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-143cef3e-db09-40d3-81ee-20fe99914a71 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:17.594623 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-7354751c-ecf4-4777-be50-5588b0349dd1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:17.598946 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-7354751c-ecf4-4777-be50-5588b0349dd1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:17.615867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7354751c-ecf4-4777-be50-5588b0349dd1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:17.620465 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7354751c-ecf4-4777-be50-5588b0349dd1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:17.621437 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7354751c-ecf4-4777-be50-5588b0349dd1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:17.621992 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7354751c-ecf4-4777-be50-5588b0349dd1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:17.671668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-143cef3e-db09-40d3-81ee-20fe99914a71 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:17.682511 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-143cef3e-db09-40d3-81ee-20fe99914a71 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:17.684053 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-143cef3e-db09-40d3-81ee-20fe99914a71 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:17.692490 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-143cef3e-db09-40d3-81ee-20fe99914a71 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1738 microversion: 2.20 time: 0.324174 May 10 03:21:17.704595 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 173/359] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:17 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1738 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:18.031645 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-7354751c-ecf4-4777-be50-5588b0349dd1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:18.045764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-7354751c-ecf4-4777-be50-5588b0349dd1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1260 microversion: 2.1 time: 0.458333 May 10 03:21:18.050366 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 187/360] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:17 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1260 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:21:18.716603 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-19d20965-f1c1-4e38-9432-4360facc3b32 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:18.723422 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-19d20965-f1c1-4e38-9432-4360facc3b32 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:18.736637 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-19d20965-f1c1-4e38-9432-4360facc3b32 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:18.737218 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-19d20965-f1c1-4e38-9432-4360facc3b32 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:18.739425 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-19d20965-f1c1-4e38-9432-4360facc3b32 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:18.743513 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-19d20965-f1c1-4e38-9432-4360facc3b32 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:19.002314 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-19d20965-f1c1-4e38-9432-4360facc3b32 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:19.013054 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-19d20965-f1c1-4e38-9432-4360facc3b32 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:19.015610 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-19d20965-f1c1-4e38-9432-4360facc3b32 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:19.018210 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-19d20965-f1c1-4e38-9432-4360facc3b32 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1738 microversion: 2.20 time: 0.307429 May 10 03:21:19.030851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 174/361] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:18 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1738 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:19.064836 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ce5b8e85-6055-41ef-ae2d-a4a95694128c tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:19.065446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ce5b8e85-6055-41ef-ae2d-a4a95694128c tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:19.077702 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ce5b8e85-6055-41ef-ae2d-a4a95694128c tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:19.084434 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ce5b8e85-6055-41ef-ae2d-a4a95694128c tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:19.085979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ce5b8e85-6055-41ef-ae2d-a4a95694128c tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:19.086807 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ce5b8e85-6055-41ef-ae2d-a4a95694128c tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:19.361254 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ce5b8e85-6055-41ef-ae2d-a4a95694128c tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:19.378511 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ce5b8e85-6055-41ef-ae2d-a4a95694128c tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1260 microversion: 2.1 time: 0.317350 May 10 03:21:19.379095 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 188/362] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:19 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1260 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:20.039923 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-95092796-9524-4a69-a0da-0fcd645c1be7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:20.042989 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-95092796-9524-4a69-a0da-0fcd645c1be7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:20.048626 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-95092796-9524-4a69-a0da-0fcd645c1be7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:20.049466 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-95092796-9524-4a69-a0da-0fcd645c1be7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:20.050490 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-95092796-9524-4a69-a0da-0fcd645c1be7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:20.051156 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-95092796-9524-4a69-a0da-0fcd645c1be7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:20.129716 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-3601147b-01bf-4943-8148-b7accc15c178 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Action: 'create', calling method: .version_select at 0x7f6a5dd44670>, body: {"keypair": {"name": "tempest-keypair-1349442515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJqEsGVeVAAMIii4BQHS41I8reyzTdtfh/8qWzLXG5QrhGXzGXnTU/62HMqeATPxQLb0jvDNysfCJHVsUzUo7X7Ff4cDirYC2/FdnnJBQUI67PYKW6lALE31cWi+G4QFg=="}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:20.159104 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-3601147b-01bf-4943-8148-b7accc15c178 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Getting quotas for project d8e319a149db44fb8bb71f3066c82956. Resources: {'key_pairs'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:21:20.165195 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-3601147b-01bf-4943-8148-b7accc15c178 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Getting quotas for user e309fb66a98b407d8b7533207e6a6dfc and project d8e319a149db44fb8bb71f3066c82956. Resources: {'key_pairs'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:21:20.280302 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-3601147b-01bf-4943-8148-b7accc15c178 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.154738 May 10 03:21:20.284940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 189/363] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 10 03:21:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:20.365113 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-95092796-9524-4a69-a0da-0fcd645c1be7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:20.380402 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-95092796-9524-4a69-a0da-0fcd645c1be7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:20.383976 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-95092796-9524-4a69-a0da-0fcd645c1be7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:20.386368 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-95092796-9524-4a69-a0da-0fcd645c1be7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1738 microversion: 2.20 time: 0.352727 May 10 03:21:20.390282 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 175/364] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:20 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1738 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:20.405738 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-794bf3d1-bb97-4537-98b1-01abf5280988 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:20.407052 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-794bf3d1-bb97-4537-98b1-01abf5280988 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:20.427446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-794bf3d1-bb97-4537-98b1-01abf5280988 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:20.427446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-794bf3d1-bb97-4537-98b1-01abf5280988 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:20.427446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-794bf3d1-bb97-4537-98b1-01abf5280988 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:20.430224 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-794bf3d1-bb97-4537-98b1-01abf5280988 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:20.721576 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-794bf3d1-bb97-4537-98b1-01abf5280988 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:20.739113 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-794bf3d1-bb97-4537-98b1-01abf5280988 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1445 microversion: 2.1 time: 0.344448 May 10 03:21:20.742426 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 190/365] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:20 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1445 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:20.765279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-bb38d36f-55c4-44a4-9bc6-a42e49f19389 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:20.769703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-bb38d36f-55c4-44a4-9bc6-a42e49f19389 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:20.777884 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bb38d36f-55c4-44a4-9bc6-a42e49f19389 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:20.778597 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bb38d36f-55c4-44a4-9bc6-a42e49f19389 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:20.779567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bb38d36f-55c4-44a4-9bc6-a42e49f19389 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:20.780216 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bb38d36f-55c4-44a4-9bc6-a42e49f19389 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:21.000385 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-bb38d36f-55c4-44a4-9bc6-a42e49f19389 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:21.012356 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-bb38d36f-55c4-44a4-9bc6-a42e49f19389 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1445 microversion: 2.1 time: 0.254594 May 10 03:21:21.026061 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 176/366] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:20 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1445 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:21.419262 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-231d74c7-41fc-41c3-a777-593869323bf6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:21.420722 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-231d74c7-41fc-41c3-a777-593869323bf6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:21.436771 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-231d74c7-41fc-41c3-a777-593869323bf6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:21.450624 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-231d74c7-41fc-41c3-a777-593869323bf6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:21.459861 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-231d74c7-41fc-41c3-a777-593869323bf6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:21.460584 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-231d74c7-41fc-41c3-a777-593869323bf6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:22.086668 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-231d74c7-41fc-41c3-a777-593869323bf6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:22.098731 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-231d74c7-41fc-41c3-a777-593869323bf6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:22.103304 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-231d74c7-41fc-41c3-a777-593869323bf6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:22.104670 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-231d74c7-41fc-41c3-a777-593869323bf6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1738 microversion: 2.20 time: 0.700417 May 10 03:21:22.106349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 191/367] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:21 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1738 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:23.127133 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-4b88176b-1c9d-4432-b8b0-d068a29d7ae0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:23.127755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-4b88176b-1c9d-4432-b8b0-d068a29d7ae0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:23.140963 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4b88176b-1c9d-4432-b8b0-d068a29d7ae0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:23.141439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4b88176b-1c9d-4432-b8b0-d068a29d7ae0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:23.142279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4b88176b-1c9d-4432-b8b0-d068a29d7ae0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:23.149898 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4b88176b-1c9d-4432-b8b0-d068a29d7ae0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:23.748586 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-4b88176b-1c9d-4432-b8b0-d068a29d7ae0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:23.760082 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-4b88176b-1c9d-4432-b8b0-d068a29d7ae0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:23.764463 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-4b88176b-1c9d-4432-b8b0-d068a29d7ae0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:23.768228 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-4b88176b-1c9d-4432-b8b0-d068a29d7ae0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1738 microversion: 2.20 time: 0.642706 May 10 03:21:23.770057 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 177/368] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:23 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1738 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:24.739260 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c228df50-321c-43c6-93d3-9941395461e2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1553078703", "imageRef": "7ce6e103-a571-4b59-9162-ff1107650c97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a79d71b-8531-4a1f-830d-d1ccd6b795ac"}], "security_groups": [{"name": "tempest-securitygroup--572750933"}], "key_name": "tempest-keypair-1349442515", "user_data": "}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:24.787604 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-1b852d24-9e55-431b-bda8-b5c9e2bb1c0c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:24.788246 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-1b852d24-9e55-431b-bda8-b5c9e2bb1c0c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:24.802188 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1b852d24-9e55-431b-bda8-b5c9e2bb1c0c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:24.803526 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1b852d24-9e55-431b-bda8-b5c9e2bb1c0c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:24.804825 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1b852d24-9e55-431b-bda8-b5c9e2bb1c0c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:24.805444 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1b852d24-9e55-431b-bda8-b5c9e2bb1c0c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:25.239884 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1b852d24-9e55-431b-bda8-b5c9e2bb1c0c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:25.256309 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1b852d24-9e55-431b-bda8-b5c9e2bb1c0c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:25.262313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1b852d24-9e55-431b-bda8-b5c9e2bb1c0c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:25.268659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-1b852d24-9e55-431b-bda8-b5c9e2bb1c0c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1738 microversion: 2.20 time: 0.481064 May 10 03:21:25.269982 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 178/369] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:24 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1738 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:25.652760 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-65c7e90f-6dd3-45a2-87c8-e4c403662f85 req-825d16c7-beba-4a90-85d2-75a180d26bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8", "tag": "d0c4a220-cc8c-4389-8209-eac5e6740986"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:25.661925 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-65c7e90f-6dd3-45a2-87c8-e4c403662f85 req-825d16c7-beba-4a90-85d2-75a180d26bd1 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:25.663314 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-65c7e90f-6dd3-45a2-87c8-e4c403662f85 req-825d16c7-beba-4a90-85d2-75a180d26bd1 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:25.699638 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-65c7e90f-6dd3-45a2-87c8-e4c403662f85 req-825d16c7-beba-4a90-85d2-75a180d26bd1 service nova] Creating event network-changed:d0c4a220-cc8c-4389-8209-eac5e6740986 for instance 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 on hv-cinder-83009 May 10 03:21:25.716842 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-65c7e90f-6dd3-45a2-87c8-e4c403662f85 req-825d16c7-beba-4a90-85d2-75a180d26bd1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067619 May 10 03:21:25.721303 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 179/370] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:21:26.315011 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-1a315f55-2620-4492-8ac7-26ce4ea5ad4b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:26.316839 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-1a315f55-2620-4492-8ac7-26ce4ea5ad4b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:26.347241 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1a315f55-2620-4492-8ac7-26ce4ea5ad4b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:26.359073 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1a315f55-2620-4492-8ac7-26ce4ea5ad4b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:26.375505 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1a315f55-2620-4492-8ac7-26ce4ea5ad4b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:26.377030 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1a315f55-2620-4492-8ac7-26ce4ea5ad4b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:26.822695 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1a315f55-2620-4492-8ac7-26ce4ea5ad4b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:26.832420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1a315f55-2620-4492-8ac7-26ce4ea5ad4b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:26.839953 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1a315f55-2620-4492-8ac7-26ce4ea5ad4b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:26.839953 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-1a315f55-2620-4492-8ac7-26ce4ea5ad4b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1738 microversion: 2.20 time: 0.556374 May 10 03:21:26.845846 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 180/371] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:26 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1738 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:27.863081 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-1d6a07a1-42dd-4b76-87a3-1022d155672d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:27.863775 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-1d6a07a1-42dd-4b76-87a3-1022d155672d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:27.871319 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1d6a07a1-42dd-4b76-87a3-1022d155672d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:27.876467 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1d6a07a1-42dd-4b76-87a3-1022d155672d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:27.876467 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1d6a07a1-42dd-4b76-87a3-1022d155672d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:27.876467 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1d6a07a1-42dd-4b76-87a3-1022d155672d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:28.092624 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1d6a07a1-42dd-4b76-87a3-1022d155672d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:28.105747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1d6a07a1-42dd-4b76-87a3-1022d155672d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:28.107227 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1d6a07a1-42dd-4b76-87a3-1022d155672d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:28.108414 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-1d6a07a1-42dd-4b76-87a3-1022d155672d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1738 microversion: 2.20 time: 0.249427 May 10 03:21:28.129686 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 181/372] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:27 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1738 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:29.130611 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-8b701e32-e964-49c7-ab1e-6b2a7c6b4d85 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:29.131320 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-8b701e32-e964-49c7-ab1e-6b2a7c6b4d85 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:29.154836 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8b701e32-e964-49c7-ab1e-6b2a7c6b4d85 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:29.155306 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8b701e32-e964-49c7-ab1e-6b2a7c6b4d85 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:29.156162 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8b701e32-e964-49c7-ab1e-6b2a7c6b4d85 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:29.156610 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8b701e32-e964-49c7-ab1e-6b2a7c6b4d85 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:29.399481 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-8b701e32-e964-49c7-ab1e-6b2a7c6b4d85 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:29.410199 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-8b701e32-e964-49c7-ab1e-6b2a7c6b4d85 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:29.412609 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-8b701e32-e964-49c7-ab1e-6b2a7c6b4d85 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:29.418341 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-8b701e32-e964-49c7-ab1e-6b2a7c6b4d85 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1738 microversion: 2.20 time: 0.292316 May 10 03:21:29.432770 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 182/373] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:29 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1738 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:30.439992 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-92ef243e-4370-4737-a47f-a436a736206a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:30.441511 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-92ef243e-4370-4737-a47f-a436a736206a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:30.448225 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-92ef243e-4370-4737-a47f-a436a736206a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:30.448941 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-92ef243e-4370-4737-a47f-a436a736206a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:30.449898 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-92ef243e-4370-4737-a47f-a436a736206a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:30.450474 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-92ef243e-4370-4737-a47f-a436a736206a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:30.663300 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-92ef243e-4370-4737-a47f-a436a736206a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:30.677920 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-92ef243e-4370-4737-a47f-a436a736206a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:30.679718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-92ef243e-4370-4737-a47f-a436a736206a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:30.681156 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-92ef243e-4370-4737-a47f-a436a736206a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1738 microversion: 2.20 time: 0.246326 May 10 03:21:30.695461 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 183/374] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:30 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1738 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:31.701382 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-e51f05c1-16aa-4079-b6ee-099ef560cff8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:31.702096 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-e51f05c1-16aa-4079-b6ee-099ef560cff8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:31.708602 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e51f05c1-16aa-4079-b6ee-099ef560cff8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:31.709012 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e51f05c1-16aa-4079-b6ee-099ef560cff8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:31.709818 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e51f05c1-16aa-4079-b6ee-099ef560cff8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:31.710255 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e51f05c1-16aa-4079-b6ee-099ef560cff8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:31.843989 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-e51f05c1-16aa-4079-b6ee-099ef560cff8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:31.853110 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-e51f05c1-16aa-4079-b6ee-099ef560cff8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:31.854630 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-e51f05c1-16aa-4079-b6ee-099ef560cff8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:31.855836 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-e51f05c1-16aa-4079-b6ee-099ef560cff8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1738 microversion: 2.20 time: 0.158413 May 10 03:21:31.856444 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 184/375] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:31 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:21:32.880472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-1b4f997d-6d4c-403c-a6c4-6e8c048ba2b0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:32.882640 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-1b4f997d-6d4c-403c-a6c4-6e8c048ba2b0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:32.894759 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1b4f997d-6d4c-403c-a6c4-6e8c048ba2b0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:32.895755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1b4f997d-6d4c-403c-a6c4-6e8c048ba2b0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:32.897743 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1b4f997d-6d4c-403c-a6c4-6e8c048ba2b0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:32.898496 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1b4f997d-6d4c-403c-a6c4-6e8c048ba2b0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:33.101235 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1b4f997d-6d4c-403c-a6c4-6e8c048ba2b0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:33.109699 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1b4f997d-6d4c-403c-a6c4-6e8c048ba2b0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:33.111423 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1b4f997d-6d4c-403c-a6c4-6e8c048ba2b0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:33.112621 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-1b4f997d-6d4c-403c-a6c4-6e8c048ba2b0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1738 microversion: 2.20 time: 0.241914 May 10 03:21:33.113507 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 185/376] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:32 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1738 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:21:33.713831 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.network.neutron [None req-c228df50-321c-43c6-93d3-9941395461e2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] validate_networks() for [('5a79d71b-8531-4a1f-830d-d1ccd6b795ac', None, None, None, None, None)] {{(pid=117399) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:21:34.132952 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-bfec1f22-f3bb-48a1-8236-adf25d832747 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:34.134322 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-bfec1f22-f3bb-48a1-8236-adf25d832747 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:34.146030 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bfec1f22-f3bb-48a1-8236-adf25d832747 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:34.151781 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bfec1f22-f3bb-48a1-8236-adf25d832747 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:34.151781 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bfec1f22-f3bb-48a1-8236-adf25d832747 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:34.151781 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bfec1f22-f3bb-48a1-8236-adf25d832747 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:34.153799 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-c228df50-321c-43c6-93d3-9941395461e2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Flavor limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:21:34.154215 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-c228df50-321c-43c6-93d3-9941395461e2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Image limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:21:34.154684 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-c228df50-321c-43c6-93d3-9941395461e2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Flavor pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:21:34.155085 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-c228df50-321c-43c6-93d3-9941395461e2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Image pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:21:34.155489 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-c228df50-321c-43c6-93d3-9941395461e2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:21:34.174279 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c228df50-321c-43c6-93d3-9941395461e2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:34.180790 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c228df50-321c-43c6-93d3-9941395461e2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:34.180790 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c228df50-321c-43c6-93d3-9941395461e2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:34.180790 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c228df50-321c-43c6-93d3-9941395461e2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:34.208947 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-c228df50-321c-43c6-93d3-9941395461e2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Getting quotas for project d8e319a149db44fb8bb71f3066c82956. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:21:34.215654 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-c228df50-321c-43c6-93d3-9941395461e2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Getting quotas for user e309fb66a98b407d8b7533207e6a6dfc and project d8e319a149db44fb8bb71f3066c82956. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:21:34.237108 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-c228df50-321c-43c6-93d3-9941395461e2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Going to run 1 instances... {{(pid=117399) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:21:34.244880 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-c228df50-321c-43c6-93d3-9941395461e2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ce6e103-a571-4b59-9162-ff1107650c97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:21:34.296977 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-bfec1f22-f3bb-48a1-8236-adf25d832747 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:34.307421 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-bfec1f22-f3bb-48a1-8236-adf25d832747 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:34.308961 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-bfec1f22-f3bb-48a1-8236-adf25d832747 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:34.310482 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-bfec1f22-f3bb-48a1-8236-adf25d832747 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1738 microversion: 2.20 time: 0.182248 May 10 03:21:34.323502 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 186/377] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:34 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:34.385910 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-c228df50-321c-43c6-93d3-9941395461e2 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 9.658689 May 10 03:21:34.396699 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-0ec1f799-7358-4b86-bb40-eaebaf239f47 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:34.396921 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 192/378] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 03:21:24 2022] POST /compute/v2.1/servers => generated 408 bytes in 9670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:21:34.397015 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-0ec1f799-7358-4b86-bb40-eaebaf239f47 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:34.474939 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-0ec1f799-7358-4b86-bb40-eaebaf239f47 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:34.483374 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-0ec1f799-7358-4b86-bb40-eaebaf239f47 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1246 microversion: 2.1 time: 0.090893 May 10 03:21:34.485795 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 187/379] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:34 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:21:35.330451 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-dc5ba74a-9e21-4a2e-af03-1d5a8c8eb8bb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:35.330996 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-dc5ba74a-9e21-4a2e-af03-1d5a8c8eb8bb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:35.337715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dc5ba74a-9e21-4a2e-af03-1d5a8c8eb8bb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:35.338170 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dc5ba74a-9e21-4a2e-af03-1d5a8c8eb8bb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:35.338982 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dc5ba74a-9e21-4a2e-af03-1d5a8c8eb8bb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:35.339424 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dc5ba74a-9e21-4a2e-af03-1d5a8c8eb8bb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:35.482319 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-dc5ba74a-9e21-4a2e-af03-1d5a8c8eb8bb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:35.496443 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-dc5ba74a-9e21-4a2e-af03-1d5a8c8eb8bb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:35.498252 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-dc5ba74a-9e21-4a2e-af03-1d5a8c8eb8bb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:35.499717 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-dc5ba74a-9e21-4a2e-af03-1d5a8c8eb8bb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1720 microversion: 2.20 time: 0.173635 May 10 03:21:35.500816 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 193/380] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:35 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:35.506597 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-c84295a6-f714-44c1-ac5c-3a49f5b9b3fa tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:35.506597 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-c84295a6-f714-44c1-ac5c-3a49f5b9b3fa tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:35.510914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c84295a6-f714-44c1-ac5c-3a49f5b9b3fa tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:35.511369 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c84295a6-f714-44c1-ac5c-3a49f5b9b3fa tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:35.512182 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c84295a6-f714-44c1-ac5c-3a49f5b9b3fa tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:35.512622 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c84295a6-f714-44c1-ac5c-3a49f5b9b3fa tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:35.574226 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-c84295a6-f714-44c1-ac5c-3a49f5b9b3fa tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:35.581574 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-c84295a6-f714-44c1-ac5c-3a49f5b9b3fa tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1250 microversion: 2.1 time: 0.082109 May 10 03:21:35.582080 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 188/381] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:35 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1250 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:36.518513 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-d1719bd5-c14a-40e0-858c-bdab695d0655 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:36.521486 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-d1719bd5-c14a-40e0-858c-bdab695d0655 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:36.526190 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d1719bd5-c14a-40e0-858c-bdab695d0655 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:36.526639 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d1719bd5-c14a-40e0-858c-bdab695d0655 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:36.527404 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d1719bd5-c14a-40e0-858c-bdab695d0655 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:36.527839 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d1719bd5-c14a-40e0-858c-bdab695d0655 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:36.598114 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-c4b3d985-800d-45e4-b50e-732b1c204b29 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:36.598726 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-c4b3d985-800d-45e4-b50e-732b1c204b29 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:36.605990 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c4b3d985-800d-45e4-b50e-732b1c204b29 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:36.606442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c4b3d985-800d-45e4-b50e-732b1c204b29 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:36.607220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c4b3d985-800d-45e4-b50e-732b1c204b29 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:36.607656 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c4b3d985-800d-45e4-b50e-732b1c204b29 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:36.691773 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-c4b3d985-800d-45e4-b50e-732b1c204b29 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:36.700515 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-c4b3d985-800d-45e4-b50e-732b1c204b29 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1250 microversion: 2.1 time: 0.106132 May 10 03:21:36.706604 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 189/382] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:36 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1250 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:21:36.706740 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-d1719bd5-c14a-40e0-858c-bdab695d0655 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:36.711921 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-d1719bd5-c14a-40e0-858c-bdab695d0655 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:36.713447 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-d1719bd5-c14a-40e0-858c-bdab695d0655 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:36.714662 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-d1719bd5-c14a-40e0-858c-bdab695d0655 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1720 microversion: 2.20 time: 0.199992 May 10 03:21:36.715148 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 194/383] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:36 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1720 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:36.730522 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-be00a244-adfd-4649-a62b-2512a7ba7b47 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Action: 'create', calling method: .version_select at 0x7f6a5d45f670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2038567233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXOG1ERa4l4l65Ht/cHZ0SYI7i1kTZOL4XNSgvTCrXkbxr/F7qs4NlNnP8JFEEJr2le+SZN6BLwzZNPrGU8wnCCCz77YPo+ov0RgWSVunwTS7TZpOISGHhgXOJwrworyQ=="}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:36.745127 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-be00a244-adfd-4649-a62b-2512a7ba7b47 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Getting quotas for project c5f50448e3cc4533a5c70bb766559548. Resources: {'key_pairs'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:21:36.748904 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-be00a244-adfd-4649-a62b-2512a7ba7b47 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Getting quotas for user b978be2083814d1f825af17697b6613c and project c5f50448e3cc4533a5c70bb766559548. Resources: {'key_pairs'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:21:36.828877 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-be00a244-adfd-4649-a62b-2512a7ba7b47 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.102066 May 10 03:21:36.831967 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 190/384] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 10 03:21:36 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:36.883624 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-782e3d43-4a4d-4906-824f-05b0801ac836 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-528945034", "imageRef": "22e8b17e-73fb-40c8-9c66-ae3c72a93f9e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2038567233", "networks": [{"uuid": "fd06a560-d19c-42bf-9edf-338d072861b7"}]}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:36.932104 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.network.neutron [None req-782e3d43-4a4d-4906-824f-05b0801ac836 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] validate_networks() for [('fd06a560-d19c-42bf-9edf-338d072861b7', None, None, None, None, None)] {{(pid=117399) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:21:37.311572 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-782e3d43-4a4d-4906-824f-05b0801ac836 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Flavor limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:21:37.312027 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-782e3d43-4a4d-4906-824f-05b0801ac836 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Image limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:21:37.312540 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-782e3d43-4a4d-4906-824f-05b0801ac836 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Flavor pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:21:37.312940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-782e3d43-4a4d-4906-824f-05b0801ac836 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Image pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:21:37.313344 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-782e3d43-4a4d-4906-824f-05b0801ac836 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:21:37.322802 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-782e3d43-4a4d-4906-824f-05b0801ac836 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:37.328872 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-782e3d43-4a4d-4906-824f-05b0801ac836 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:37.328872 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-782e3d43-4a4d-4906-824f-05b0801ac836 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:37.328872 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-782e3d43-4a4d-4906-824f-05b0801ac836 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:37.340745 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-782e3d43-4a4d-4906-824f-05b0801ac836 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Getting quotas for project c5f50448e3cc4533a5c70bb766559548. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:21:37.344399 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-782e3d43-4a4d-4906-824f-05b0801ac836 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Getting quotas for user b978be2083814d1f825af17697b6613c and project c5f50448e3cc4533a5c70bb766559548. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:21:37.354902 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-782e3d43-4a4d-4906-824f-05b0801ac836 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Going to run 1 instances... {{(pid=117399) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:21:37.356922 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-782e3d43-4a4d-4906-824f-05b0801ac836 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22e8b17e-73fb-40c8-9c66-ae3c72a93f9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:21:37.524031 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-782e3d43-4a4d-4906-824f-05b0801ac836 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644238 May 10 03:21:37.524720 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 195/385] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 03:21:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:21:37.534859 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-2f0c0ea3-8c45-4dc7-9ac7-927bf5303336 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:37.535478 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-2f0c0ea3-8c45-4dc7-9ac7-927bf5303336 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:37.604205 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-2f0c0ea3-8c45-4dc7-9ac7-927bf5303336 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:37.616070 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-2f0c0ea3-8c45-4dc7-9ac7-927bf5303336 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1258 microversion: 2.1 time: 0.084620 May 10 03:21:37.617111 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 191/386] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:37 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1258 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:37.661579 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-7dfdb95a-d5ef-4edf-bed8-ce73018a4be8 req-727f4b53-d598-45c3-907d-f4650363702b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8796004-8adb-4534-a094-c62dfd2a9636", "name": "network-vif-unplugged", "status": "completed", "tag": "373a71b7-374a-4584-ad6b-1d09a234ef37"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:37.670969 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-7dfdb95a-d5ef-4edf-bed8-ce73018a4be8 req-727f4b53-d598-45c3-907d-f4650363702b service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:37.671527 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-7dfdb95a-d5ef-4edf-bed8-ce73018a4be8 req-727f4b53-d598-45c3-907d-f4650363702b service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:37.685313 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-7dfdb95a-d5ef-4edf-bed8-ce73018a4be8 req-727f4b53-d598-45c3-907d-f4650363702b service nova] Creating event network-vif-unplugged:373a71b7-374a-4584-ad6b-1d09a234ef37 for instance e8796004-8adb-4534-a094-c62dfd2a9636 on hv-cinder-83009 May 10 03:21:37.695423 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-7dfdb95a-d5ef-4edf-bed8-ce73018a4be8 req-727f4b53-d598-45c3-907d-f4650363702b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037081 May 10 03:21:37.696486 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 196/387] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:37.717099 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-9637f90c-2c77-4719-b033-1cc790a911da tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:37.717722 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-9637f90c-2c77-4719-b033-1cc790a911da tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:37.723665 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9637f90c-2c77-4719-b033-1cc790a911da tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:37.724141 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9637f90c-2c77-4719-b033-1cc790a911da tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:37.725522 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9637f90c-2c77-4719-b033-1cc790a911da tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:37.725952 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9637f90c-2c77-4719-b033-1cc790a911da tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:37.732882 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-f5c11796-4cf3-41bb-a6a5-1a002ba8f909 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:37.735009 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-f5c11796-4cf3-41bb-a6a5-1a002ba8f909 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:37.739521 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f5c11796-4cf3-41bb-a6a5-1a002ba8f909 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:37.739965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f5c11796-4cf3-41bb-a6a5-1a002ba8f909 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:37.741657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f5c11796-4cf3-41bb-a6a5-1a002ba8f909 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:37.742217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f5c11796-4cf3-41bb-a6a5-1a002ba8f909 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:37.800523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-9637f90c-2c77-4719-b033-1cc790a911da tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:37.812965 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-9637f90c-2c77-4719-b033-1cc790a911da tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1298 microversion: 2.1 time: 0.099498 May 10 03:21:37.814296 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 192/388] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:37 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1298 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:37.898710 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-f5c11796-4cf3-41bb-a6a5-1a002ba8f909 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:37.906572 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-f5c11796-4cf3-41bb-a6a5-1a002ba8f909 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:37.908372 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-f5c11796-4cf3-41bb-a6a5-1a002ba8f909 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:37.909696 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-f5c11796-4cf3-41bb-a6a5-1a002ba8f909 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1723 microversion: 2.20 time: 0.180997 May 10 03:21:37.910245 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 197/389] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:37 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:37.929120 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-8dc6ff8b-1440-43e1-89d3-c377c4bb4aac tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c177a52d-047b-4f62-b076-34958ce03686"}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:37.930385 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-8dc6ff8b-1440-43e1-89d3-c377c4bb4aac tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:37.936744 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8dc6ff8b-1440-43e1-89d3-c377c4bb4aac tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:37.937320 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8dc6ff8b-1440-43e1-89d3-c377c4bb4aac tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:37.938315 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8dc6ff8b-1440-43e1-89d3-c377c4bb4aac tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:37.938846 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8dc6ff8b-1440-43e1-89d3-c377c4bb4aac tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:38.634909 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ad4ee1b2-4850-4d37-8935-0fc73686a4e1 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:38.635658 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ad4ee1b2-4850-4d37-8935-0fc73686a4e1 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:38.692717 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ad4ee1b2-4850-4d37-8935-0fc73686a4e1 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:38.699946 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ad4ee1b2-4850-4d37-8935-0fc73686a4e1 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1258 microversion: 2.1 time: 0.069908 May 10 03:21:38.700543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 198/390] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:38 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:21:38.841956 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-0e0fe749-790b-4d77-a8d8-f855de10addf tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:38.842579 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-0e0fe749-790b-4d77-a8d8-f855de10addf tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:38.849344 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0e0fe749-790b-4d77-a8d8-f855de10addf tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:38.849822 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0e0fe749-790b-4d77-a8d8-f855de10addf tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:38.850617 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0e0fe749-790b-4d77-a8d8-f855de10addf tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:38.851089 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0e0fe749-790b-4d77-a8d8-f855de10addf tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:38.987985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-0e0fe749-790b-4d77-a8d8-f855de10addf tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:38.995370 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-0e0fe749-790b-4d77-a8d8-f855de10addf tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.159618 May 10 03:21:38.995945 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 199/391] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:38 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:39.124069 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-8dc6ff8b-1440-43e1-89d3-c377c4bb4aac tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "POST /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.199889 May 10 03:21:39.129883 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 193/392] 10.222.0.65 () {62 vars in 1363 bytes} [Tue May 10 03:21:37 2022] POST /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636/os-volume_attachments => generated 188 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:21:39.247945 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-13d0a108-dc09-4f04-9fb0-bd41bc8ab3d2 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:39.248945 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-13d0a108-dc09-4f04-9fb0-bd41bc8ab3d2 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:39.255322 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-13d0a108-dc09-4f04-9fb0-bd41bc8ab3d2 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:39.256328 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-13d0a108-dc09-4f04-9fb0-bd41bc8ab3d2 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:39.257122 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-13d0a108-dc09-4f04-9fb0-bd41bc8ab3d2 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:39.257559 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-13d0a108-dc09-4f04-9fb0-bd41bc8ab3d2 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:39.536145 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-13d0a108-dc09-4f04-9fb0-bd41bc8ab3d2 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "POST /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636/action" status: 202 len: 0 microversion: 2.20 time: 0.292066 May 10 03:21:39.540569 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 200/393] 10.222.0.65 () {62 vars in 1318 bytes} [Tue May 10 03:21:39 2022] POST /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 03:21:39.545802 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-746bd1c1-6111-409f-a934-3bb0428217ba tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:39.546669 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-746bd1c1-6111-409f-a934-3bb0428217ba tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:39.556438 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-746bd1c1-6111-409f-a934-3bb0428217ba tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:39.557497 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-746bd1c1-6111-409f-a934-3bb0428217ba tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:39.557987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-746bd1c1-6111-409f-a934-3bb0428217ba tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:39.558523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-746bd1c1-6111-409f-a934-3bb0428217ba tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:39.711542 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-746bd1c1-6111-409f-a934-3bb0428217ba tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:39.717397 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-d29c7472-c7c1-47d6-8ec0-679f138eb684 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:39.718773 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-d29c7472-c7c1-47d6-8ec0-679f138eb684 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:39.725524 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-746bd1c1-6111-409f-a934-3bb0428217ba tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:39.728126 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-746bd1c1-6111-409f-a934-3bb0428217ba tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:39.728489 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d29c7472-c7c1-47d6-8ec0-679f138eb684 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:39.729545 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d29c7472-c7c1-47d6-8ec0-679f138eb684 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:39.730033 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-746bd1c1-6111-409f-a934-3bb0428217ba tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1749 microversion: 2.20 time: 0.187836 May 10 03:21:39.730809 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d29c7472-c7c1-47d6-8ec0-679f138eb684 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:39.731486 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d29c7472-c7c1-47d6-8ec0-679f138eb684 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:39.732908 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 194/394] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:39 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1749 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:39.814309 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-d29c7472-c7c1-47d6-8ec0-679f138eb684 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:39.821901 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-d29c7472-c7c1-47d6-8ec0-679f138eb684 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1310 microversion: 2.1 time: 0.108794 May 10 03:21:39.822741 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 201/395] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:39 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1310 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:21:39.890228 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-b6a676d4-5105-44b4-8597-2eceabea6602 req-7c2f9a5e-d751-4095-a822-7488f3c5750d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a010d765-8dc4-44a9-922a-feabd172565b", "tag": "3d3f8b1a-cfaf-4bd6-babb-ab9bd3c7b319"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:39.899336 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-b6a676d4-5105-44b4-8597-2eceabea6602 req-7c2f9a5e-d751-4095-a822-7488f3c5750d service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:39.899878 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-b6a676d4-5105-44b4-8597-2eceabea6602 req-7c2f9a5e-d751-4095-a822-7488f3c5750d service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:39.913880 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-b6a676d4-5105-44b4-8597-2eceabea6602 req-7c2f9a5e-d751-4095-a822-7488f3c5750d service nova] Creating event network-changed:3d3f8b1a-cfaf-4bd6-babb-ab9bd3c7b319 for instance a010d765-8dc4-44a9-922a-feabd172565b on hv-cinder-83009 May 10 03:21:39.919305 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-b6a676d4-5105-44b4-8597-2eceabea6602 req-7c2f9a5e-d751-4095-a822-7488f3c5750d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033123 May 10 03:21:39.920380 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 195/396] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:40.020704 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a4062aac-b259-4b91-8b53-a84022f6889c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:40.021514 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-a4062aac-b259-4b91-8b53-a84022f6889c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:40.030366 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a4062aac-b259-4b91-8b53-a84022f6889c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:40.031084 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a4062aac-b259-4b91-8b53-a84022f6889c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:40.032131 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a4062aac-b259-4b91-8b53-a84022f6889c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:40.032591 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a4062aac-b259-4b91-8b53-a84022f6889c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:40.184419 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-a4062aac-b259-4b91-8b53-a84022f6889c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:40.193994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-a4062aac-b259-4b91-8b53-a84022f6889c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.177022 May 10 03:21:40.202972 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 202/397] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:40 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:40.751753 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-5cd7f233-d71f-4a3f-bdd6-4366b9523262 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:40.752671 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-5cd7f233-d71f-4a3f-bdd6-4366b9523262 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:40.760029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5cd7f233-d71f-4a3f-bdd6-4366b9523262 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:40.760514 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5cd7f233-d71f-4a3f-bdd6-4366b9523262 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:40.761272 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5cd7f233-d71f-4a3f-bdd6-4366b9523262 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:40.761709 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5cd7f233-d71f-4a3f-bdd6-4366b9523262 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:40.839709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-466eb866-3b44-48fa-ad54-f51c21a08658 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:40.848941 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-466eb866-3b44-48fa-ad54-f51c21a08658 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:40.848941 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-466eb866-3b44-48fa-ad54-f51c21a08658 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:40.848941 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-466eb866-3b44-48fa-ad54-f51c21a08658 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:40.850336 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-466eb866-3b44-48fa-ad54-f51c21a08658 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:40.851180 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-466eb866-3b44-48fa-ad54-f51c21a08658 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:40.951372 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-466eb866-3b44-48fa-ad54-f51c21a08658 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:40.975869 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-466eb866-3b44-48fa-ad54-f51c21a08658 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1316 microversion: 2.1 time: 0.134335 May 10 03:21:40.976955 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 203/398] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:40 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1316 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:21:41.014826 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5cd7f233-d71f-4a3f-bdd6-4366b9523262 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:41.036270 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5cd7f233-d71f-4a3f-bdd6-4366b9523262 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:41.040420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5cd7f233-d71f-4a3f-bdd6-4366b9523262 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:41.042854 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-5cd7f233-d71f-4a3f-bdd6-4366b9523262 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1749 microversion: 2.20 time: 0.295611 May 10 03:21:41.045453 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 196/399] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:40 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1749 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:41.211263 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-45ae10ec-ab14-4c46-b2b6-9ebfeed5d0fc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:41.212314 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-45ae10ec-ab14-4c46-b2b6-9ebfeed5d0fc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:41.223984 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-45ae10ec-ab14-4c46-b2b6-9ebfeed5d0fc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:41.225291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-45ae10ec-ab14-4c46-b2b6-9ebfeed5d0fc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:41.228889 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-45ae10ec-ab14-4c46-b2b6-9ebfeed5d0fc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:41.229392 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-45ae10ec-ab14-4c46-b2b6-9ebfeed5d0fc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:41.417312 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-45ae10ec-ab14-4c46-b2b6-9ebfeed5d0fc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:41.429685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-45ae10ec-ab14-4c46-b2b6-9ebfeed5d0fc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.222661 May 10 03:21:41.439823 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 204/400] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:41 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:41.994287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-00601371-bdbe-4f60-a089-dc1372dbed44 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:41.994957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-00601371-bdbe-4f60-a089-dc1372dbed44 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:42.001662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-00601371-bdbe-4f60-a089-dc1372dbed44 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:42.002103 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-00601371-bdbe-4f60-a089-dc1372dbed44 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:42.002869 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-00601371-bdbe-4f60-a089-dc1372dbed44 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:42.003477 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-00601371-bdbe-4f60-a089-dc1372dbed44 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:42.071911 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-30c2b828-f95d-4e19-bd38-cb0df22c7a95 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:42.071911 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-30c2b828-f95d-4e19-bd38-cb0df22c7a95 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:42.076038 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-30c2b828-f95d-4e19-bd38-cb0df22c7a95 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:42.076577 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-30c2b828-f95d-4e19-bd38-cb0df22c7a95 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:42.077423 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-30c2b828-f95d-4e19-bd38-cb0df22c7a95 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:42.078035 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-30c2b828-f95d-4e19-bd38-cb0df22c7a95 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:42.198939 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-00601371-bdbe-4f60-a089-dc1372dbed44 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:42.206231 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-00601371-bdbe-4f60-a089-dc1372dbed44 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.216487 May 10 03:21:42.211083 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 197/401] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:41 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:42.246664 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-30c2b828-f95d-4e19-bd38-cb0df22c7a95 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:42.255404 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-30c2b828-f95d-4e19-bd38-cb0df22c7a95 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:42.257053 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-30c2b828-f95d-4e19-bd38-cb0df22c7a95 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:42.258652 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-30c2b828-f95d-4e19-bd38-cb0df22c7a95 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1749 microversion: 2.20 time: 0.194049 May 10 03:21:42.259317 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 205/402] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:42 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1749 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:42.446992 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-e206a90a-6ab5-4bf7-87d8-75e93f763e80 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:42.447719 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-e206a90a-6ab5-4bf7-87d8-75e93f763e80 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:42.457214 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e206a90a-6ab5-4bf7-87d8-75e93f763e80 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:42.458178 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e206a90a-6ab5-4bf7-87d8-75e93f763e80 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:42.459310 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e206a90a-6ab5-4bf7-87d8-75e93f763e80 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:42.459745 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e206a90a-6ab5-4bf7-87d8-75e93f763e80 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:42.830750 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-e206a90a-6ab5-4bf7-87d8-75e93f763e80 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:42.845458 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-e206a90a-6ab5-4bf7-87d8-75e93f763e80 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.402542 May 10 03:21:42.846471 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 198/403] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:42 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:43.225620 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ed07548b-47ed-4afb-8a7b-eae12d4f8ea5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:43.226243 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ed07548b-47ed-4afb-8a7b-eae12d4f8ea5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:43.232520 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ed07548b-47ed-4afb-8a7b-eae12d4f8ea5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:43.233024 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ed07548b-47ed-4afb-8a7b-eae12d4f8ea5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:43.233828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ed07548b-47ed-4afb-8a7b-eae12d4f8ea5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:43.234376 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ed07548b-47ed-4afb-8a7b-eae12d4f8ea5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:43.277590 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-5e4b8293-22ad-47c9-b7d8-898db5e4cfa8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:43.278292 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-5e4b8293-22ad-47c9-b7d8-898db5e4cfa8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:43.284695 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5e4b8293-22ad-47c9-b7d8-898db5e4cfa8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:43.285148 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5e4b8293-22ad-47c9-b7d8-898db5e4cfa8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:43.285952 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5e4b8293-22ad-47c9-b7d8-898db5e4cfa8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:43.286398 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5e4b8293-22ad-47c9-b7d8-898db5e4cfa8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:43.411066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ed07548b-47ed-4afb-8a7b-eae12d4f8ea5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:43.419528 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ed07548b-47ed-4afb-8a7b-eae12d4f8ea5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.198270 May 10 03:21:43.420785 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 206/404] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:43 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:43.465030 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5e4b8293-22ad-47c9-b7d8-898db5e4cfa8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:43.470624 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5e4b8293-22ad-47c9-b7d8-898db5e4cfa8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:43.472252 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5e4b8293-22ad-47c9-b7d8-898db5e4cfa8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:43.473686 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-5e4b8293-22ad-47c9-b7d8-898db5e4cfa8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1749 microversion: 2.20 time: 0.199936 May 10 03:21:43.474265 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 199/405] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:43 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1749 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:21:43.863133 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-49a40dc2-44d1-4e5f-b43b-9fdcc312dc3b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:43.863936 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-49a40dc2-44d1-4e5f-b43b-9fdcc312dc3b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:43.870247 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-49a40dc2-44d1-4e5f-b43b-9fdcc312dc3b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:43.870784 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-49a40dc2-44d1-4e5f-b43b-9fdcc312dc3b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:43.871654 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-49a40dc2-44d1-4e5f-b43b-9fdcc312dc3b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:43.872197 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-49a40dc2-44d1-4e5f-b43b-9fdcc312dc3b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:44.022279 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-49a40dc2-44d1-4e5f-b43b-9fdcc312dc3b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:44.031245 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-49a40dc2-44d1-4e5f-b43b-9fdcc312dc3b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.171828 May 10 03:21:44.032086 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 207/406] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:43 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:44.437477 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-edc48903-7b04-4c7d-8a1a-b6bd84c33e2e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:44.438732 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-edc48903-7b04-4c7d-8a1a-b6bd84c33e2e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:44.445866 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-edc48903-7b04-4c7d-8a1a-b6bd84c33e2e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:44.446323 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-edc48903-7b04-4c7d-8a1a-b6bd84c33e2e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:44.447109 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-edc48903-7b04-4c7d-8a1a-b6bd84c33e2e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:44.447550 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-edc48903-7b04-4c7d-8a1a-b6bd84c33e2e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:44.495319 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-27003d2f-93df-4c42-9a20-82344f084788 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:44.496186 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-27003d2f-93df-4c42-9a20-82344f084788 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:44.504831 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-27003d2f-93df-4c42-9a20-82344f084788 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:44.505561 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-27003d2f-93df-4c42-9a20-82344f084788 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:44.507513 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-27003d2f-93df-4c42-9a20-82344f084788 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:44.508142 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-27003d2f-93df-4c42-9a20-82344f084788 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:44.652743 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-edc48903-7b04-4c7d-8a1a-b6bd84c33e2e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:44.661216 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-edc48903-7b04-4c7d-8a1a-b6bd84c33e2e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.226959 May 10 03:21:44.664158 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 200/407] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:44 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:44.684171 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-27003d2f-93df-4c42-9a20-82344f084788 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:44.692873 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-27003d2f-93df-4c42-9a20-82344f084788 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:44.694838 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-27003d2f-93df-4c42-9a20-82344f084788 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:44.696023 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-27003d2f-93df-4c42-9a20-82344f084788 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1749 microversion: 2.20 time: 0.206130 May 10 03:21:44.696588 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 208/408] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:44 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1749 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:21:45.048808 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-31877413-2620-4630-93b0-8234d5d4aad0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:45.049326 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-31877413-2620-4630-93b0-8234d5d4aad0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:45.055258 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-31877413-2620-4630-93b0-8234d5d4aad0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:45.055703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-31877413-2620-4630-93b0-8234d5d4aad0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:45.056563 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-31877413-2620-4630-93b0-8234d5d4aad0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:45.056996 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-31877413-2620-4630-93b0-8234d5d4aad0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:45.198847 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-31877413-2620-4630-93b0-8234d5d4aad0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:45.206475 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-31877413-2620-4630-93b0-8234d5d4aad0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.161470 May 10 03:21:45.207295 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 201/409] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:45 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:45.680668 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-268bf250-e4ab-4c95-983e-10048b18bff2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:45.682084 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-268bf250-e4ab-4c95-983e-10048b18bff2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:45.688786 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-268bf250-e4ab-4c95-983e-10048b18bff2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:45.689237 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-268bf250-e4ab-4c95-983e-10048b18bff2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:45.690033 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-268bf250-e4ab-4c95-983e-10048b18bff2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:45.690464 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-268bf250-e4ab-4c95-983e-10048b18bff2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:45.714048 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-f03900c7-8b44-49ae-99fb-7b4630434290 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:45.715345 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-f03900c7-8b44-49ae-99fb-7b4630434290 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:45.722397 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f03900c7-8b44-49ae-99fb-7b4630434290 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:45.732392 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f03900c7-8b44-49ae-99fb-7b4630434290 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:45.734697 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f03900c7-8b44-49ae-99fb-7b4630434290 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:45.735214 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f03900c7-8b44-49ae-99fb-7b4630434290 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:45.889874 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-268bf250-e4ab-4c95-983e-10048b18bff2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:45.899176 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-268bf250-e4ab-4c95-983e-10048b18bff2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.223902 May 10 03:21:45.908541 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 209/410] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:45 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:45.919606 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-f03900c7-8b44-49ae-99fb-7b4630434290 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:45.922163 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-f03900c7-8b44-49ae-99fb-7b4630434290 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:45.923652 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-f03900c7-8b44-49ae-99fb-7b4630434290 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:45.924838 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-f03900c7-8b44-49ae-99fb-7b4630434290 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1749 microversion: 2.20 time: 0.214679 May 10 03:21:45.925406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 202/411] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:45 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1749 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:21:46.223170 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-36c04789-507a-42e4-8bfe-d9295086d0f9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:46.223699 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-36c04789-507a-42e4-8bfe-d9295086d0f9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:46.229816 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-36c04789-507a-42e4-8bfe-d9295086d0f9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:46.230243 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-36c04789-507a-42e4-8bfe-d9295086d0f9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:46.231017 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-36c04789-507a-42e4-8bfe-d9295086d0f9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:46.231457 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-36c04789-507a-42e4-8bfe-d9295086d0f9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:46.369607 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-36c04789-507a-42e4-8bfe-d9295086d0f9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:46.377077 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-36c04789-507a-42e4-8bfe-d9295086d0f9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.157811 May 10 03:21:46.377628 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 210/412] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:46 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:46.917039 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-2ee983e4-a908-4861-a663-7101340d928d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:46.917647 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-2ee983e4-a908-4861-a663-7101340d928d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:46.923934 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2ee983e4-a908-4861-a663-7101340d928d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:46.924419 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2ee983e4-a908-4861-a663-7101340d928d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:46.925185 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2ee983e4-a908-4861-a663-7101340d928d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:46.925626 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2ee983e4-a908-4861-a663-7101340d928d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:46.942714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-448c43b4-5d1c-4dd6-8e64-fd267e29c5e5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:46.943320 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-448c43b4-5d1c-4dd6-8e64-fd267e29c5e5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:46.951294 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-448c43b4-5d1c-4dd6-8e64-fd267e29c5e5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:46.951850 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-448c43b4-5d1c-4dd6-8e64-fd267e29c5e5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:46.953006 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-448c43b4-5d1c-4dd6-8e64-fd267e29c5e5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:46.953509 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-448c43b4-5d1c-4dd6-8e64-fd267e29c5e5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:47.138324 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-2ee983e4-a908-4861-a663-7101340d928d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:47.144655 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-448c43b4-5d1c-4dd6-8e64-fd267e29c5e5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:47.146035 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-2ee983e4-a908-4861-a663-7101340d928d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.233688 May 10 03:21:47.146824 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 203/413] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:46 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:47.152981 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-448c43b4-5d1c-4dd6-8e64-fd267e29c5e5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:47.154453 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-448c43b4-5d1c-4dd6-8e64-fd267e29c5e5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:47.155589 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-448c43b4-5d1c-4dd6-8e64-fd267e29c5e5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1749 microversion: 2.20 time: 0.216689 May 10 03:21:47.156161 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 211/414] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:46 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1749 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:21:47.395042 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-418170b4-0d06-474b-b536-f74123bd0ab0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:47.395681 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-418170b4-0d06-474b-b536-f74123bd0ab0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:47.401903 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-418170b4-0d06-474b-b536-f74123bd0ab0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:47.402350 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-418170b4-0d06-474b-b536-f74123bd0ab0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:47.403132 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-418170b4-0d06-474b-b536-f74123bd0ab0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:47.403569 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-418170b4-0d06-474b-b536-f74123bd0ab0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:47.543661 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-418170b4-0d06-474b-b536-f74123bd0ab0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:47.551110 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-418170b4-0d06-474b-b536-f74123bd0ab0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.160008 May 10 03:21:47.551885 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 204/415] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:47 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:48.162899 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-4307a8ed-458a-49d5-af6c-0098d16cf6bc tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:48.163497 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-4307a8ed-458a-49d5-af6c-0098d16cf6bc tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:48.170328 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4307a8ed-458a-49d5-af6c-0098d16cf6bc tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:48.170841 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4307a8ed-458a-49d5-af6c-0098d16cf6bc tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:48.171717 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4307a8ed-458a-49d5-af6c-0098d16cf6bc tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:48.172186 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4307a8ed-458a-49d5-af6c-0098d16cf6bc tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:48.174425 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-ab020b81-26f6-40ca-99b4-01b93e75d8a8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:48.175287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-ab020b81-26f6-40ca-99b4-01b93e75d8a8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:48.182896 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ab020b81-26f6-40ca-99b4-01b93e75d8a8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:48.183337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ab020b81-26f6-40ca-99b4-01b93e75d8a8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:48.184135 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ab020b81-26f6-40ca-99b4-01b93e75d8a8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:48.184566 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ab020b81-26f6-40ca-99b4-01b93e75d8a8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:48.396077 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-4307a8ed-458a-49d5-af6c-0098d16cf6bc tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:48.399144 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ab020b81-26f6-40ca-99b4-01b93e75d8a8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:48.405658 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-4307a8ed-458a-49d5-af6c-0098d16cf6bc tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.246992 May 10 03:21:48.407539 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ab020b81-26f6-40ca-99b4-01b93e75d8a8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:48.409074 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ab020b81-26f6-40ca-99b4-01b93e75d8a8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:48.410223 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-ab020b81-26f6-40ca-99b4-01b93e75d8a8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1749 microversion: 2.20 time: 0.239766 May 10 03:21:48.412048 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 205/416] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:48 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1749 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:21:48.415923 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 212/417] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:48 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:48.568896 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-2f00deef-cf79-4f7d-b770-1d177eb0d13a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:48.570041 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-2f00deef-cf79-4f7d-b770-1d177eb0d13a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:48.578359 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2f00deef-cf79-4f7d-b770-1d177eb0d13a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:48.580702 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2f00deef-cf79-4f7d-b770-1d177eb0d13a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:48.580702 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2f00deef-cf79-4f7d-b770-1d177eb0d13a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:48.580702 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2f00deef-cf79-4f7d-b770-1d177eb0d13a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:48.720868 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-2f00deef-cf79-4f7d-b770-1d177eb0d13a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:48.730151 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-2f00deef-cf79-4f7d-b770-1d177eb0d13a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.165228 May 10 03:21:48.730763 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 206/418] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:48 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:49.426235 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-8d772624-9be9-402f-bc2d-6d805ca493ac tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:49.426892 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8d772624-9be9-402f-bc2d-6d805ca493ac tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:49.430444 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-72018bbe-5cef-4c98-8ae9-973aa9e8bd98 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:49.431054 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-72018bbe-5cef-4c98-8ae9-973aa9e8bd98 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:49.433530 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8d772624-9be9-402f-bc2d-6d805ca493ac tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:49.433981 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8d772624-9be9-402f-bc2d-6d805ca493ac tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:49.434753 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8d772624-9be9-402f-bc2d-6d805ca493ac tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:49.435221 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8d772624-9be9-402f-bc2d-6d805ca493ac tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:49.437118 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-72018bbe-5cef-4c98-8ae9-973aa9e8bd98 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:49.437571 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-72018bbe-5cef-4c98-8ae9-973aa9e8bd98 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:49.438418 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-72018bbe-5cef-4c98-8ae9-973aa9e8bd98 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:49.438894 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-72018bbe-5cef-4c98-8ae9-973aa9e8bd98 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:49.641468 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8d772624-9be9-402f-bc2d-6d805ca493ac tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:49.649358 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-8d772624-9be9-402f-bc2d-6d805ca493ac tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.229997 May 10 03:21:49.649935 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 213/419] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:49 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:49.653225 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-72018bbe-5cef-4c98-8ae9-973aa9e8bd98 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:49.661971 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-72018bbe-5cef-4c98-8ae9-973aa9e8bd98 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:49.664065 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-72018bbe-5cef-4c98-8ae9-973aa9e8bd98 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:49.665244 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-72018bbe-5cef-4c98-8ae9-973aa9e8bd98 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1749 microversion: 2.20 time: 0.239264 May 10 03:21:49.666067 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 207/420] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:49 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1749 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:21:49.746563 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-7f950f7b-e89a-4284-bae3-6d92dc198651 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:49.747167 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-7f950f7b-e89a-4284-bae3-6d92dc198651 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:49.753189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7f950f7b-e89a-4284-bae3-6d92dc198651 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:49.753642 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7f950f7b-e89a-4284-bae3-6d92dc198651 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:49.754409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7f950f7b-e89a-4284-bae3-6d92dc198651 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:49.754852 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7f950f7b-e89a-4284-bae3-6d92dc198651 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:49.885751 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-7f950f7b-e89a-4284-bae3-6d92dc198651 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:49.893270 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-7f950f7b-e89a-4284-bae3-6d92dc198651 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.150507 May 10 03:21:49.893835 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 214/421] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:49 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:50.666325 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-5cd1340a-1357-4792-9997-130bfbdc2847 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:50.666939 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-5cd1340a-1357-4792-9997-130bfbdc2847 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:50.673639 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5cd1340a-1357-4792-9997-130bfbdc2847 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:50.674086 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5cd1340a-1357-4792-9997-130bfbdc2847 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:50.674886 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5cd1340a-1357-4792-9997-130bfbdc2847 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:50.675314 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5cd1340a-1357-4792-9997-130bfbdc2847 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:50.685593 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-91b7de01-6b40-4737-8f39-052f953a430b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:50.686385 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-91b7de01-6b40-4737-8f39-052f953a430b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:50.693133 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-91b7de01-6b40-4737-8f39-052f953a430b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:50.694121 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-91b7de01-6b40-4737-8f39-052f953a430b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:50.695049 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-91b7de01-6b40-4737-8f39-052f953a430b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:50.696049 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-91b7de01-6b40-4737-8f39-052f953a430b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:50.870249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5cd1340a-1357-4792-9997-130bfbdc2847 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:50.876880 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-91b7de01-6b40-4737-8f39-052f953a430b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:50.877578 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-5cd1340a-1357-4792-9997-130bfbdc2847 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.215286 May 10 03:21:50.880036 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 208/422] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:50 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:50.886266 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-91b7de01-6b40-4737-8f39-052f953a430b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:50.888040 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-91b7de01-6b40-4737-8f39-052f953a430b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:50.889201 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-91b7de01-6b40-4737-8f39-052f953a430b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1751 microversion: 2.20 time: 0.207751 May 10 03:21:50.889743 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 215/423] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:50 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1751 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:50.910353 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-8d887d3b-04c7-44c7-bf92-ed22f5f3801e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:50.910966 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-8d887d3b-04c7-44c7-bf92-ed22f5f3801e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:50.921318 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8d887d3b-04c7-44c7-bf92-ed22f5f3801e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:50.921774 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8d887d3b-04c7-44c7-bf92-ed22f5f3801e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:50.922549 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8d887d3b-04c7-44c7-bf92-ed22f5f3801e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:50.922993 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8d887d3b-04c7-44c7-bf92-ed22f5f3801e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:51.070814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-8d887d3b-04c7-44c7-bf92-ed22f5f3801e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:51.078383 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-8d887d3b-04c7-44c7-bf92-ed22f5f3801e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.171818 May 10 03:21:51.079066 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 209/424] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:50 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:51.275180 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-f10bfde3-e077-4523-b42e-0fbf6461fd99 req-10fdc08b-1ca5-4abc-9a6a-105ec7ace407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eedf1629-9431-4b77-92e3-253377280b0b", "tag": "28d80747-ff10-4f4c-93bb-2b2d343c9e8e"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:51.285067 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-f10bfde3-e077-4523-b42e-0fbf6461fd99 req-10fdc08b-1ca5-4abc-9a6a-105ec7ace407 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:51.285645 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-f10bfde3-e077-4523-b42e-0fbf6461fd99 req-10fdc08b-1ca5-4abc-9a6a-105ec7ace407 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:51.298346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-f10bfde3-e077-4523-b42e-0fbf6461fd99 req-10fdc08b-1ca5-4abc-9a6a-105ec7ace407 service nova] Creating event network-changed:28d80747-ff10-4f4c-93bb-2b2d343c9e8e for instance eedf1629-9431-4b77-92e3-253377280b0b on hv-cinder-83009 May 10 03:21:51.303301 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-f10bfde3-e077-4523-b42e-0fbf6461fd99 req-10fdc08b-1ca5-4abc-9a6a-105ec7ace407 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033400 May 10 03:21:51.303986 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 216/425] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:51.895363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-2b9f8ce7-0aa2-45f8-9370-e0a6a3cf7b6b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:51.896073 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-2b9f8ce7-0aa2-45f8-9370-e0a6a3cf7b6b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:51.903021 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2b9f8ce7-0aa2-45f8-9370-e0a6a3cf7b6b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:51.903528 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2b9f8ce7-0aa2-45f8-9370-e0a6a3cf7b6b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:51.904391 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2b9f8ce7-0aa2-45f8-9370-e0a6a3cf7b6b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:51.904828 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2b9f8ce7-0aa2-45f8-9370-e0a6a3cf7b6b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:51.914971 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-8c5dc556-6a0f-4de4-9aaa-0fcbc4285739 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:51.916023 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8c5dc556-6a0f-4de4-9aaa-0fcbc4285739 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:51.922403 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8c5dc556-6a0f-4de4-9aaa-0fcbc4285739 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:51.922894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8c5dc556-6a0f-4de4-9aaa-0fcbc4285739 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:51.923729 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8c5dc556-6a0f-4de4-9aaa-0fcbc4285739 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:51.924261 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8c5dc556-6a0f-4de4-9aaa-0fcbc4285739 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:52.094338 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-2b9f8ce7-0aa2-45f8-9370-e0a6a3cf7b6b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:52.102221 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-2b9f8ce7-0aa2-45f8-9370-e0a6a3cf7b6b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.210514 May 10 03:21:52.102948 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 210/426] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:51 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:52.107589 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-4cb69d71-94e2-437e-87e6-ec902701df67 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:52.108225 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-4cb69d71-94e2-437e-87e6-ec902701df67 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:52.114432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4cb69d71-94e2-437e-87e6-ec902701df67 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:52.114888 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4cb69d71-94e2-437e-87e6-ec902701df67 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:52.115709 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4cb69d71-94e2-437e-87e6-ec902701df67 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:52.116179 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4cb69d71-94e2-437e-87e6-ec902701df67 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:52.117576 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8c5dc556-6a0f-4de4-9aaa-0fcbc4285739 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:52.125826 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8c5dc556-6a0f-4de4-9aaa-0fcbc4285739 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:52.127549 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8c5dc556-6a0f-4de4-9aaa-0fcbc4285739 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:52.128800 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-8c5dc556-6a0f-4de4-9aaa-0fcbc4285739 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1751 microversion: 2.20 time: 0.219304 May 10 03:21:52.129361 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 217/427] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:51 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1751 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:21:52.195329 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-8d3b8163-9bd4-45ed-be92-b9471fba6661 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:52.195888 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8d3b8163-9bd4-45ed-be92-b9471fba6661 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:52.201771 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8d3b8163-9bd4-45ed-be92-b9471fba6661 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:52.202294 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8d3b8163-9bd4-45ed-be92-b9471fba6661 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:52.211499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8d3b8163-9bd4-45ed-be92-b9471fba6661 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:52.211983 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8d3b8163-9bd4-45ed-be92-b9471fba6661 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:52.265535 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-4cb69d71-94e2-437e-87e6-ec902701df67 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:52.273449 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-4cb69d71-94e2-437e-87e6-ec902701df67 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.169320 May 10 03:21:52.276955 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 211/428] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:52 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:52.351913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.objects.instance [None req-8d3b8163-9bd4-45ed-be92-b9471fba6661 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lazy-loading 'services' on Instance uuid 1813031a-ba52-4826-9b73-69ae2af70c13 {{(pid=117399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:21:52.687389 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-8d3b8163-9bd4-45ed-be92-b9471fba6661 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "DELETE /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13/os-volume_attachments/32a6aa10-0382-49f9-a3f4-0ba3e923c2be" status: 202 len: 0 microversion: 2.1 time: 0.496600 May 10 03:21:52.687990 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 218/429] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 10 03:21:52 2022] DELETE /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13/os-volume_attachments/32a6aa10-0382-49f9-a3f4-0ba3e923c2be => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:21:53.119116 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-cb6c8c53-eeda-458a-aac3-5992ebf4f787 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:53.119647 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-cb6c8c53-eeda-458a-aac3-5992ebf4f787 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:53.125927 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cb6c8c53-eeda-458a-aac3-5992ebf4f787 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:53.126376 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cb6c8c53-eeda-458a-aac3-5992ebf4f787 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:53.127132 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cb6c8c53-eeda-458a-aac3-5992ebf4f787 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:53.127565 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cb6c8c53-eeda-458a-aac3-5992ebf4f787 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:53.149283 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-3cc8e3ff-9eae-484b-9a58-af8d490dbbee tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:53.149980 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-3cc8e3ff-9eae-484b-9a58-af8d490dbbee tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:53.155994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3cc8e3ff-9eae-484b-9a58-af8d490dbbee tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:53.156487 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3cc8e3ff-9eae-484b-9a58-af8d490dbbee tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:53.157259 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3cc8e3ff-9eae-484b-9a58-af8d490dbbee tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:53.157699 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3cc8e3ff-9eae-484b-9a58-af8d490dbbee tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:53.304928 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-cb6c8c53-eeda-458a-aac3-5992ebf4f787 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:53.312182 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-cb6c8c53-eeda-458a-aac3-5992ebf4f787 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.196910 May 10 03:21:53.312752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 212/430] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:53 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:53.317275 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-70be04d6-7e79-4293-9e75-f12c22047950 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:53.317870 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-70be04d6-7e79-4293-9e75-f12c22047950 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:53.323590 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-70be04d6-7e79-4293-9e75-f12c22047950 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:53.328025 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-70be04d6-7e79-4293-9e75-f12c22047950 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:53.328025 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-70be04d6-7e79-4293-9e75-f12c22047950 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:53.328025 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-70be04d6-7e79-4293-9e75-f12c22047950 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:53.330483 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-3cc8e3ff-9eae-484b-9a58-af8d490dbbee tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:53.339516 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-3cc8e3ff-9eae-484b-9a58-af8d490dbbee tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:53.341054 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-3cc8e3ff-9eae-484b-9a58-af8d490dbbee tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:53.342193 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-3cc8e3ff-9eae-484b-9a58-af8d490dbbee tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1751 microversion: 2.20 time: 0.198121 May 10 03:21:53.342969 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 219/431] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:53 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1751 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:21:53.451829 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-70be04d6-7e79-4293-9e75-f12c22047950 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:53.459988 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-70be04d6-7e79-4293-9e75-f12c22047950 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.145603 May 10 03:21:53.460600 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 213/432] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:53 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:54.328992 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-17f81306-b70e-4bf9-aa39-22524f138d6d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:54.329599 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-17f81306-b70e-4bf9-aa39-22524f138d6d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:54.335928 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-17f81306-b70e-4bf9-aa39-22524f138d6d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:54.336634 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-17f81306-b70e-4bf9-aa39-22524f138d6d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:54.337408 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-17f81306-b70e-4bf9-aa39-22524f138d6d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:54.337840 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-17f81306-b70e-4bf9-aa39-22524f138d6d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:54.361125 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-7c1596d5-56ea-4f18-aba5-2cee80d68089 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:54.362180 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-7c1596d5-56ea-4f18-aba5-2cee80d68089 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:54.369287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7c1596d5-56ea-4f18-aba5-2cee80d68089 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:54.369846 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7c1596d5-56ea-4f18-aba5-2cee80d68089 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:54.370624 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7c1596d5-56ea-4f18-aba5-2cee80d68089 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:54.371066 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7c1596d5-56ea-4f18-aba5-2cee80d68089 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:54.523929 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-17f81306-b70e-4bf9-aa39-22524f138d6d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:54.533838 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-17f81306-b70e-4bf9-aa39-22524f138d6d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.208778 May 10 03:21:54.538943 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 220/433] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:54 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:54.547917 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-7c1596d5-56ea-4f18-aba5-2cee80d68089 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:54.549403 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ed57213f-ee0e-40d7-b0f8-eb3c91a6e7b5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:54.552874 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ed57213f-ee0e-40d7-b0f8-eb3c91a6e7b5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:54.557074 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-7c1596d5-56ea-4f18-aba5-2cee80d68089 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:54.558890 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-7c1596d5-56ea-4f18-aba5-2cee80d68089 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:54.560121 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-7c1596d5-56ea-4f18-aba5-2cee80d68089 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1807 microversion: 2.20 time: 0.203784 May 10 03:21:54.560844 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 214/434] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:54 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:21:54.564107 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ed57213f-ee0e-40d7-b0f8-eb3c91a6e7b5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:54.564107 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ed57213f-ee0e-40d7-b0f8-eb3c91a6e7b5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:54.564107 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ed57213f-ee0e-40d7-b0f8-eb3c91a6e7b5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:54.564107 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ed57213f-ee0e-40d7-b0f8-eb3c91a6e7b5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:54.695429 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ed57213f-ee0e-40d7-b0f8-eb3c91a6e7b5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:54.711478 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ed57213f-ee0e-40d7-b0f8-eb3c91a6e7b5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.175045 May 10 03:21:54.713468 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 221/435] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:54 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:54.861612 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a7424624-332a-4efd-b31c-3e1fd3549040 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:54.867861 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a7424624-332a-4efd-b31c-3e1fd3549040 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:54.868348 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a7424624-332a-4efd-b31c-3e1fd3549040 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:54.928086 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-a7424624-332a-4efd-b31c-3e1fd3549040 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Going to try to stop instance {{(pid=117400) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 03:21:55.094062 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-a7424624-332a-4efd-b31c-3e1fd3549040 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "POST /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13/action" status: 202 len: 0 microversion: 2.1 time: 0.236015 May 10 03:21:55.094790 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 215/436] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 03:21:54 2022] POST /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 03:21:55.102744 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-b16272e8-bfbb-408b-8aac-f969ea8df3ea tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:55.103476 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-b16272e8-bfbb-408b-8aac-f969ea8df3ea tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:55.109675 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b16272e8-bfbb-408b-8aac-f969ea8df3ea tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:55.110207 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b16272e8-bfbb-408b-8aac-f969ea8df3ea tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:55.111101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b16272e8-bfbb-408b-8aac-f969ea8df3ea tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:55.111560 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b16272e8-bfbb-408b-8aac-f969ea8df3ea tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:55.240983 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-b16272e8-bfbb-408b-8aac-f969ea8df3ea tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:55.248271 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-b16272e8-bfbb-408b-8aac-f969ea8df3ea tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1676 microversion: 2.1 time: 0.149335 May 10 03:21:55.248842 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 222/437] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:55 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:55.552714 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-9067186d-956b-4717-b210-41009df8116b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:55.553933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-9067186d-956b-4717-b210-41009df8116b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:55.560091 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9067186d-956b-4717-b210-41009df8116b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:55.560544 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9067186d-956b-4717-b210-41009df8116b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:55.561402 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9067186d-956b-4717-b210-41009df8116b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:55.561894 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9067186d-956b-4717-b210-41009df8116b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:55.578397 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-7203428c-693e-4e40-8898-1c043104b3c5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:55.579529 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-7203428c-693e-4e40-8898-1c043104b3c5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:55.587162 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7203428c-693e-4e40-8898-1c043104b3c5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:55.587618 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7203428c-693e-4e40-8898-1c043104b3c5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:55.588668 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7203428c-693e-4e40-8898-1c043104b3c5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:55.596324 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7203428c-693e-4e40-8898-1c043104b3c5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:55.832784 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-9067186d-956b-4717-b210-41009df8116b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:55.842017 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-9067186d-956b-4717-b210-41009df8116b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.294069 May 10 03:21:55.842582 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 216/438] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:55 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:55.850373 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-7203428c-693e-4e40-8898-1c043104b3c5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:55.862834 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-7203428c-693e-4e40-8898-1c043104b3c5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:55.868819 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-0bde541b-d68c-4aa3-a43b-32de7506da87 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:55.871299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-7203428c-693e-4e40-8898-1c043104b3c5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:55.872552 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-7203428c-693e-4e40-8898-1c043104b3c5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1807 microversion: 2.20 time: 0.297949 May 10 03:21:55.873407 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-0bde541b-d68c-4aa3-a43b-32de7506da87 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:55.875082 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 223/439] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:55 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1807 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:55.884379 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0bde541b-d68c-4aa3-a43b-32de7506da87 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:55.885094 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0bde541b-d68c-4aa3-a43b-32de7506da87 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:55.886143 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0bde541b-d68c-4aa3-a43b-32de7506da87 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:55.886849 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0bde541b-d68c-4aa3-a43b-32de7506da87 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:56.016608 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-57d7cedc-557d-4203-9677-c59881207295 req-ea568b76-5720-4e9f-9276-97ab31d1db54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a010d765-8dc4-44a9-922a-feabd172565b", "name": "network-vif-plugged", "status": "completed", "tag": "3d3f8b1a-cfaf-4bd6-babb-ab9bd3c7b319"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:56.029060 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-57d7cedc-557d-4203-9677-c59881207295 req-ea568b76-5720-4e9f-9276-97ab31d1db54 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:56.029427 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-57d7cedc-557d-4203-9677-c59881207295 req-ea568b76-5720-4e9f-9276-97ab31d1db54 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:56.059549 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-57d7cedc-557d-4203-9677-c59881207295 req-ea568b76-5720-4e9f-9276-97ab31d1db54 service nova] Creating event network-vif-plugged:3d3f8b1a-cfaf-4bd6-babb-ab9bd3c7b319 for instance a010d765-8dc4-44a9-922a-feabd172565b on hv-cinder-83009 May 10 03:21:56.073296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-57d7cedc-557d-4203-9677-c59881207295 req-ea568b76-5720-4e9f-9276-97ab31d1db54 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060691 May 10 03:21:56.074345 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 224/440] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:21:56.087221 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-0bde541b-d68c-4aa3-a43b-32de7506da87 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:56.095114 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-0bde541b-d68c-4aa3-a43b-32de7506da87 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.237132 May 10 03:21:56.095695 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 217/441] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:55 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:56.266401 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-9b95e7f9-818a-4473-8324-1ad256db4166 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:56.267474 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-9b95e7f9-818a-4473-8324-1ad256db4166 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:56.277339 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9b95e7f9-818a-4473-8324-1ad256db4166 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:56.277886 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9b95e7f9-818a-4473-8324-1ad256db4166 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:56.278755 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9b95e7f9-818a-4473-8324-1ad256db4166 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:56.279285 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9b95e7f9-818a-4473-8324-1ad256db4166 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:56.426518 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-9b95e7f9-818a-4473-8324-1ad256db4166 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:56.433828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-9b95e7f9-818a-4473-8324-1ad256db4166 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1676 microversion: 2.1 time: 0.171806 May 10 03:21:56.434527 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 225/442] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:56 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:56.864719 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-365df6c1-bdcf-4202-abfb-8b4fc77d922c tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:56.865879 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-365df6c1-bdcf-4202-abfb-8b4fc77d922c tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:56.877388 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-365df6c1-bdcf-4202-abfb-8b4fc77d922c tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:56.878149 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-365df6c1-bdcf-4202-abfb-8b4fc77d922c tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:56.880049 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-365df6c1-bdcf-4202-abfb-8b4fc77d922c tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:56.880835 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-365df6c1-bdcf-4202-abfb-8b4fc77d922c tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:56.892813 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ffaf8832-2769-452c-aa3c-e51c7c487c80 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:56.894097 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ffaf8832-2769-452c-aa3c-e51c7c487c80 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:56.910958 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ffaf8832-2769-452c-aa3c-e51c7c487c80 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:56.911413 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ffaf8832-2769-452c-aa3c-e51c7c487c80 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:56.914805 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ffaf8832-2769-452c-aa3c-e51c7c487c80 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:56.915262 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ffaf8832-2769-452c-aa3c-e51c7c487c80 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:57.105914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-365df6c1-bdcf-4202-abfb-8b4fc77d922c tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:57.113586 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-365df6c1-bdcf-4202-abfb-8b4fc77d922c tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.255075 May 10 03:21:57.114252 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 218/443] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:56 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:57.125950 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ffaf8832-2769-452c-aa3c-e51c7c487c80 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:57.130156 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ffaf8832-2769-452c-aa3c-e51c7c487c80 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:57.132476 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ffaf8832-2769-452c-aa3c-e51c7c487c80 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:57.132876 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-d8f34293-d44e-48de-9304-e4ef5744af67 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:57.133713 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-d8f34293-d44e-48de-9304-e4ef5744af67 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:57.133961 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ffaf8832-2769-452c-aa3c-e51c7c487c80 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1807 microversion: 2.20 time: 0.245561 May 10 03:21:57.135164 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 226/444] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:56 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:21:57.152272 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d8f34293-d44e-48de-9304-e4ef5744af67 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:57.152719 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d8f34293-d44e-48de-9304-e4ef5744af67 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:57.153549 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d8f34293-d44e-48de-9304-e4ef5744af67 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:57.153983 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d8f34293-d44e-48de-9304-e4ef5744af67 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:57.340765 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-d8f34293-d44e-48de-9304-e4ef5744af67 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:57.350247 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-d8f34293-d44e-48de-9304-e4ef5744af67 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.222740 May 10 03:21:57.366918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 219/445] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:57 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:57.461923 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-d0c8ca24-e896-41f8-8ee7-b2125197a37a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:57.462767 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-d0c8ca24-e896-41f8-8ee7-b2125197a37a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:57.469508 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d0c8ca24-e896-41f8-8ee7-b2125197a37a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:57.470157 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d0c8ca24-e896-41f8-8ee7-b2125197a37a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:57.471136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d0c8ca24-e896-41f8-8ee7-b2125197a37a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:57.471574 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d0c8ca24-e896-41f8-8ee7-b2125197a37a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:57.612168 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-d0c8ca24-e896-41f8-8ee7-b2125197a37a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:57.621173 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-d0c8ca24-e896-41f8-8ee7-b2125197a37a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1676 microversion: 2.1 time: 0.164353 May 10 03:21:57.621868 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 227/446] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:57 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:58.098385 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-1f6fb659-6bc2-4b45-a5f7-a020932c20f5 req-7667862a-7955-475f-8fe9-ec3de8bdaf3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eedf1629-9431-4b77-92e3-253377280b0b", "name": "network-vif-plugged", "status": "completed", "tag": "28d80747-ff10-4f4c-93bb-2b2d343c9e8e"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:21:58.107267 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-1f6fb659-6bc2-4b45-a5f7-a020932c20f5 req-7667862a-7955-475f-8fe9-ec3de8bdaf3b service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:58.107720 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-1f6fb659-6bc2-4b45-a5f7-a020932c20f5 req-7667862a-7955-475f-8fe9-ec3de8bdaf3b service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:58.118675 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-1f6fb659-6bc2-4b45-a5f7-a020932c20f5 req-7667862a-7955-475f-8fe9-ec3de8bdaf3b service nova] Creating event network-vif-plugged:28d80747-ff10-4f4c-93bb-2b2d343c9e8e for instance eedf1629-9431-4b77-92e3-253377280b0b on hv-cinder-83009 May 10 03:21:58.123929 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-1f6fb659-6bc2-4b45-a5f7-a020932c20f5 req-7667862a-7955-475f-8fe9-ec3de8bdaf3b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029106 May 10 03:21:58.124572 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 220/447] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:21:58.135204 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-7cf38b42-68cc-4866-91ec-7ac2ef08596d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:58.135812 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-7cf38b42-68cc-4866-91ec-7ac2ef08596d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:58.142218 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7cf38b42-68cc-4866-91ec-7ac2ef08596d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:58.142665 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7cf38b42-68cc-4866-91ec-7ac2ef08596d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:58.143465 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7cf38b42-68cc-4866-91ec-7ac2ef08596d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:58.143897 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7cf38b42-68cc-4866-91ec-7ac2ef08596d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:58.153258 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-80b9e68e-cf4e-4c1a-a453-a6f26758cc85 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:58.154035 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-80b9e68e-cf4e-4c1a-a453-a6f26758cc85 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:58.160126 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-80b9e68e-cf4e-4c1a-a453-a6f26758cc85 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:58.160652 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-80b9e68e-cf4e-4c1a-a453-a6f26758cc85 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:58.161514 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-80b9e68e-cf4e-4c1a-a453-a6f26758cc85 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:58.162025 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-80b9e68e-cf4e-4c1a-a453-a6f26758cc85 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:58.347926 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-7cf38b42-68cc-4866-91ec-7ac2ef08596d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:58.356324 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-7cf38b42-68cc-4866-91ec-7ac2ef08596d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.226668 May 10 03:21:58.357488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 228/448] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:58 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:58.365218 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-80b9e68e-cf4e-4c1a-a453-a6f26758cc85 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:58.371163 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-0545f9d7-719e-4f83-9588-2f88d33fc190 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:58.372852 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-0545f9d7-719e-4f83-9588-2f88d33fc190 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:58.379064 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-80b9e68e-cf4e-4c1a-a453-a6f26758cc85 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:58.380606 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-80b9e68e-cf4e-4c1a-a453-a6f26758cc85 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:58.381818 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-80b9e68e-cf4e-4c1a-a453-a6f26758cc85 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1807 microversion: 2.20 time: 0.232726 May 10 03:21:58.382708 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 221/449] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:58 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1807 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:21:58.384593 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0545f9d7-719e-4f83-9588-2f88d33fc190 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:58.385159 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0545f9d7-719e-4f83-9588-2f88d33fc190 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:58.386146 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0545f9d7-719e-4f83-9588-2f88d33fc190 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:58.386721 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0545f9d7-719e-4f83-9588-2f88d33fc190 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:58.530439 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-0545f9d7-719e-4f83-9588-2f88d33fc190 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:58.539056 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-0545f9d7-719e-4f83-9588-2f88d33fc190 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.172020 May 10 03:21:58.539902 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 229/450] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:58 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:21:58.642770 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-9ec1200e-fdb2-4636-bfa8-d866a8b3befc tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:58.642770 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-9ec1200e-fdb2-4636-bfa8-d866a8b3befc tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:58.646100 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9ec1200e-fdb2-4636-bfa8-d866a8b3befc tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:58.647173 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9ec1200e-fdb2-4636-bfa8-d866a8b3befc tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:58.648130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9ec1200e-fdb2-4636-bfa8-d866a8b3befc tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:58.648668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9ec1200e-fdb2-4636-bfa8-d866a8b3befc tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:58.791494 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-9ec1200e-fdb2-4636-bfa8-d866a8b3befc tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:58.799050 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-9ec1200e-fdb2-4636-bfa8-d866a8b3befc tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1676 microversion: 2.1 time: 0.164639 May 10 03:21:58.799637 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 222/451] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:58 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:59.373230 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-9c5ab3d1-3e1e-4d41-a28a-ee8e4c353ed6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:59.373835 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-9c5ab3d1-3e1e-4d41-a28a-ee8e4c353ed6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:59.380358 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9c5ab3d1-3e1e-4d41-a28a-ee8e4c353ed6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:59.380818 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9c5ab3d1-3e1e-4d41-a28a-ee8e4c353ed6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:59.381762 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9c5ab3d1-3e1e-4d41-a28a-ee8e4c353ed6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:59.382198 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9c5ab3d1-3e1e-4d41-a28a-ee8e4c353ed6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:59.400518 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-0c80ae98-241e-42f4-ad77-a620dbb509de tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:59.401850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-0c80ae98-241e-42f4-ad77-a620dbb509de tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:59.408711 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0c80ae98-241e-42f4-ad77-a620dbb509de tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:59.409252 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0c80ae98-241e-42f4-ad77-a620dbb509de tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:59.410286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0c80ae98-241e-42f4-ad77-a620dbb509de tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:59.410939 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0c80ae98-241e-42f4-ad77-a620dbb509de tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:59.579523 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-9c5ab3d1-3e1e-4d41-a28a-ee8e4c353ed6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:59.588763 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-9c5ab3d1-3e1e-4d41-a28a-ee8e4c353ed6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.219202 May 10 03:21:59.589353 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 230/452] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:59 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:59.605108 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a9002723-d32c-4e74-8917-41d875f7063d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:59.605725 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-a9002723-d32c-4e74-8917-41d875f7063d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:59.612208 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a9002723-d32c-4e74-8917-41d875f7063d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:59.612661 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a9002723-d32c-4e74-8917-41d875f7063d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:59.612887 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-0c80ae98-241e-42f4-ad77-a620dbb509de tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:59.613452 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a9002723-d32c-4e74-8917-41d875f7063d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:59.613893 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a9002723-d32c-4e74-8917-41d875f7063d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:59.623502 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-0c80ae98-241e-42f4-ad77-a620dbb509de tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:59.624966 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-0c80ae98-241e-42f4-ad77-a620dbb509de tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:59.626143 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-0c80ae98-241e-42f4-ad77-a620dbb509de tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1807 microversion: 2.20 time: 0.230099 May 10 03:21:59.636508 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 223/453] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:21:59 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:21:59.759672 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-a9002723-d32c-4e74-8917-41d875f7063d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:59.766853 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-a9002723-d32c-4e74-8917-41d875f7063d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.176532 May 10 03:21:59.767415 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 231/454] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:59 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:59.816626 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-e915766d-2fdc-4a6a-b1b4-d8b1ce340cee tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:59.817364 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-e915766d-2fdc-4a6a-b1b4-d8b1ce340cee tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:59.824617 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e915766d-2fdc-4a6a-b1b4-d8b1ce340cee tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:59.825139 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e915766d-2fdc-4a6a-b1b4-d8b1ce340cee tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:59.825986 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e915766d-2fdc-4a6a-b1b4-d8b1ce340cee tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:59.826498 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e915766d-2fdc-4a6a-b1b4-d8b1ce340cee tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:59.961563 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-e915766d-2fdc-4a6a-b1b4-d8b1ce340cee tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:21:59.969661 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-e915766d-2fdc-4a6a-b1b4-d8b1ce340cee tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1676 microversion: 2.1 time: 0.156757 May 10 03:21:59.970501 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 224/455] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:21:59 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:21:59.987473 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-820a3cd7-8283-4fb6-9341-d36e067510e5 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:21:59.987968 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-820a3cd7-8283-4fb6-9341-d36e067510e5 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:21:59.994118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-820a3cd7-8283-4fb6-9341-d36e067510e5 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:59.994566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-820a3cd7-8283-4fb6-9341-d36e067510e5 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:21:59.995339 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-820a3cd7-8283-4fb6-9341-d36e067510e5 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:21:59.995773 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-820a3cd7-8283-4fb6-9341-d36e067510e5 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:00.019342 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-820a3cd7-8283-4fb6-9341-d36e067510e5 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b/ips" status: 200 len: 150 microversion: 2.1 time: 0.035632 May 10 03:22:00.019924 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 232/456] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 10 03:21:59 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:22:00.031208 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-0dad2220-1bb3-44a0-95fc-71dc684b523c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc46e0f6-ea49-48d7-9af0-6488aec07e24"}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:00.032359 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-0dad2220-1bb3-44a0-95fc-71dc684b523c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:00.038966 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0dad2220-1bb3-44a0-95fc-71dc684b523c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:00.039415 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0dad2220-1bb3-44a0-95fc-71dc684b523c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:00.040234 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0dad2220-1bb3-44a0-95fc-71dc684b523c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:00.040687 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0dad2220-1bb3-44a0-95fc-71dc684b523c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:00.120940 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-0dad2220-1bb3-44a0-95fc-71dc684b523c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] HTTP exception thrown: Invalid volume: volume bc46e0f6-ea49-48d7-9af0-6488aec07e24 is already attached to instances: a275173c-51a6-4cc6-aef2-b30bcee8b67b May 10 03:22:00.122662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-0dad2220-1bb3-44a0-95fc-71dc684b523c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Request method failure captured: May 10 03:22:00.122662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: POST /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b/os-volume_attachments HTTP/1.1 May 10 03:22:00.122662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:22:00.122662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:22:00.122662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:22:00.122662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 74 May 10 03:22:00.122662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:22:00.122662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:22:00.122662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:22:00.122662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:22:00.122662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedm7QRYCgCmNpOHEq-xocEssXcoKFt3Cw-xUSJVkpdbWkcE2a4swkD5OOWo0sIcmaGXBYMa4anhP-9-xwsnmr7TD0HDae0_ZejhV9Z7LARWPFLjL5ozyZp775dsZG_BfqUR5n4ZQlWeOoqrl2-8Sk1TTVheuLGMVx-c_z5Xm6ARd90Q May 10 03:22:00.122662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:22:00.122662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:22:00.122662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:22:00.122662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:22:00.122662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:22:00.122662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:22:00.122662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:22:00.122662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:22:00.122662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:22:00.122662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:22:00.124241 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b7c607953b94c02977d60c0b0536e24", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b7c607953b94c02977d60c0b0536e24"}]}] May 10 03:22:00.124241 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:22:00.124241 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:22:00.124241 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:22:00.124241 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:22:00.124241 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:22:00.124241 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:22:00.124241 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: 9407e88fdbd74ba196ffd9fd221e15f5 May 10 03:22:00.124241 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:22:00.124241 dv-cinder-830094-4-smb devstack@n-api.service[117400]: May 10 03:22:00.124241 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {"volumeAttachment": {"volumeId": "bc46e0f6-ea49-48d7-9af0-6488aec07e24"}} May 10 03:22:00.124241 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:22:00.125200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Invalid volume: volume bc46e0f6-ea49-48d7-9af0-6488aec07e24 is already attached to instances: a275173c-51a6-4cc6-aef2-b30bcee8b67b May 10 03:22:00.125200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'server_id': '25e932f1-fc8d-4515-b33f-e1ba788e850b', 'body': {'volumeAttachment': {'volumeId': 'bc46e0f6-ea49-48d7-9af0-6488aec07e24'}}} May 10 03:22:00.125200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:22:00.125200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:22:00.125200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 03:22:00.125200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 03:22:00.125200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 03:22:00.125200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 03:22:00.125200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 03:22:00.125200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 03:22:00.125200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 03:22:00.125200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 03:22:00.125200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 03:22:00.125200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 03:22:00.125200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bc46e0f6-ea49-48d7-9af0-6488aec07e24 is already attached to instances: a275173c-51a6-4cc6-aef2-b30bcee8b67b May 10 03:22:00.125200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:22:00.125200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:22:00.125200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:22:00.125200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:22:00.126344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:22:00.126344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:22:00.126344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:22:00.126344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:22:00.126344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:22:00.126344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:22:00.126344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 03:22:00.126344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:22:00.126344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 03:22:00.126344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:22:00.126344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 03:22:00.126344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:22:00.126344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 03:22:00.126344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 03:22:00.126344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bc46e0f6-ea49-48d7-9af0-6488aec07e24 is already attached to instances: a275173c-51a6-4cc6-aef2-b30bcee8b67b May 10 03:22:00.126344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:22:00.126344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:22:00.126344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:22:00.126344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:22:00.126344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:22:00.127555 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:22:00.127555 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:22:00.127555 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:22:00.127555 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bc46e0f6-ea49-48d7-9af0-6488aec07e24 is already attached to instances: a275173c-51a6-4cc6-aef2-b30bcee8b67b May 10 03:22:00.127555 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:22:00.127555 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-0dad2220-1bb3-44a0-95fc-71dc684b523c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Returning 400 to user: Invalid volume: volume bc46e0f6-ea49-48d7-9af0-6488aec07e24 is already attached to instances: a275173c-51a6-4cc6-aef2-b30bcee8b67b {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:22:00.127555 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-0dad2220-1bb3-44a0-95fc-71dc684b523c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "POST /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097106 May 10 03:22:00.127555 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 225/457] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 03:22:00 2022] POST /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 03:22:00.133547 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-7ef54198-d4d3-41d6-a773-019a77f13ec0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:00.134047 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-7ef54198-d4d3-41d6-a773-019a77f13ec0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:00.140453 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7ef54198-d4d3-41d6-a773-019a77f13ec0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:00.140986 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7ef54198-d4d3-41d6-a773-019a77f13ec0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:00.141838 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7ef54198-d4d3-41d6-a773-019a77f13ec0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:00.142347 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7ef54198-d4d3-41d6-a773-019a77f13ec0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:00.171022 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-7ef54198-d4d3-41d6-a773-019a77f13ec0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Going to try to terminate instance {{(pid=117399) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:22:00.491454 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-7ef54198-d4d3-41d6-a773-019a77f13ec0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "DELETE /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 204 len: 0 microversion: 2.1 time: 0.360893 May 10 03:22:00.492167 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 233/458] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:22:00 2022] DELETE /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:22:00.500250 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-7f8ba028-172b-4882-a848-10c5264d30a3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:00.500865 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-7f8ba028-172b-4882-a848-10c5264d30a3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:00.508264 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7f8ba028-172b-4882-a848-10c5264d30a3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:00.508795 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7f8ba028-172b-4882-a848-10c5264d30a3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:00.509607 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7f8ba028-172b-4882-a848-10c5264d30a3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:00.510248 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7f8ba028-172b-4882-a848-10c5264d30a3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:00.612906 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-dde3690b-22b4-4daa-8548-76af3efefe19 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:00.613970 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-dde3690b-22b4-4daa-8548-76af3efefe19 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:00.625020 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dde3690b-22b4-4daa-8548-76af3efefe19 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:00.625466 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dde3690b-22b4-4daa-8548-76af3efefe19 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:00.626246 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dde3690b-22b4-4daa-8548-76af3efefe19 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:00.626684 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dde3690b-22b4-4daa-8548-76af3efefe19 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:00.651440 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-7f8ba028-172b-4882-a848-10c5264d30a3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:00.658832 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-7f8ba028-172b-4882-a848-10c5264d30a3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1682 microversion: 2.1 time: 0.162356 May 10 03:22:00.659612 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 226/459] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:00 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:00.680100 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-39afeeae-3763-4969-bd8c-4e7c2a1b70bb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:00.680748 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-39afeeae-3763-4969-bd8c-4e7c2a1b70bb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:00.687047 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-39afeeae-3763-4969-bd8c-4e7c2a1b70bb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:00.687509 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-39afeeae-3763-4969-bd8c-4e7c2a1b70bb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:00.688428 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-39afeeae-3763-4969-bd8c-4e7c2a1b70bb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:00.689048 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-39afeeae-3763-4969-bd8c-4e7c2a1b70bb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:00.835990 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-dde3690b-22b4-4daa-8548-76af3efefe19 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:00.843259 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-dde3690b-22b4-4daa-8548-76af3efefe19 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.240831 May 10 03:22:00.843828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 234/460] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:00 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:00.848225 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c4bf7bde-6f06-40d1-9439-43d898f37868 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:00.848957 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-c4bf7bde-6f06-40d1-9439-43d898f37868 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:00.854764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c4bf7bde-6f06-40d1-9439-43d898f37868 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:00.855227 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c4bf7bde-6f06-40d1-9439-43d898f37868 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:00.856065 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c4bf7bde-6f06-40d1-9439-43d898f37868 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:00.856515 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c4bf7bde-6f06-40d1-9439-43d898f37868 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:00.863868 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-39afeeae-3763-4969-bd8c-4e7c2a1b70bb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:00.873161 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-39afeeae-3763-4969-bd8c-4e7c2a1b70bb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:00.874687 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-39afeeae-3763-4969-bd8c-4e7c2a1b70bb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:00.875870 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-39afeeae-3763-4969-bd8c-4e7c2a1b70bb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1807 microversion: 2.20 time: 0.215550 May 10 03:22:00.876828 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 227/461] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:22:00 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:22:00.987595 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-fe8c8076-9ab2-4cd4-8dfe-6367c6b81b84 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:00.988259 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-fe8c8076-9ab2-4cd4-8dfe-6367c6b81b84 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:00.995216 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fe8c8076-9ab2-4cd4-8dfe-6367c6b81b84 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:00.996346 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fe8c8076-9ab2-4cd4-8dfe-6367c6b81b84 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:00.997364 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fe8c8076-9ab2-4cd4-8dfe-6367c6b81b84 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:00.997817 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fe8c8076-9ab2-4cd4-8dfe-6367c6b81b84 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:01.005886 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-c4bf7bde-6f06-40d1-9439-43d898f37868 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:01.020333 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-c4bf7bde-6f06-40d1-9439-43d898f37868 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.175227 May 10 03:22:01.028973 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 235/462] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:00 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:01.132616 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-fe8c8076-9ab2-4cd4-8dfe-6367c6b81b84 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:01.140261 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-fe8c8076-9ab2-4cd4-8dfe-6367c6b81b84 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1676 microversion: 2.1 time: 0.156643 May 10 03:22:01.140990 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 228/463] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:00 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:22:01.677280 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-5af4bd84-9cd2-4cc9-8f7c-e696b3977334 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:01.678096 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-5af4bd84-9cd2-4cc9-8f7c-e696b3977334 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:01.684844 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5af4bd84-9cd2-4cc9-8f7c-e696b3977334 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:01.685301 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5af4bd84-9cd2-4cc9-8f7c-e696b3977334 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:01.686089 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5af4bd84-9cd2-4cc9-8f7c-e696b3977334 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:01.686530 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5af4bd84-9cd2-4cc9-8f7c-e696b3977334 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:01.817992 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-5af4bd84-9cd2-4cc9-8f7c-e696b3977334 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:01.826055 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-5af4bd84-9cd2-4cc9-8f7c-e696b3977334 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1682 microversion: 2.1 time: 0.152715 May 10 03:22:01.826628 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 236/464] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:01 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:01.859085 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-320537f5-67a0-4c24-83a8-0360be6c1804 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:01.859696 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-320537f5-67a0-4c24-83a8-0360be6c1804 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:01.866109 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-320537f5-67a0-4c24-83a8-0360be6c1804 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:01.866555 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-320537f5-67a0-4c24-83a8-0360be6c1804 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:01.867319 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-320537f5-67a0-4c24-83a8-0360be6c1804 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:01.867752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-320537f5-67a0-4c24-83a8-0360be6c1804 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:01.894757 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-03a1f03b-d1ca-4f8f-a9ac-685085a8fcaf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:01.895470 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-03a1f03b-d1ca-4f8f-a9ac-685085a8fcaf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:01.902390 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-03a1f03b-d1ca-4f8f-a9ac-685085a8fcaf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:01.902938 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-03a1f03b-d1ca-4f8f-a9ac-685085a8fcaf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:01.903733 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-03a1f03b-d1ca-4f8f-a9ac-685085a8fcaf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:01.906891 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-03a1f03b-d1ca-4f8f-a9ac-685085a8fcaf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:02.064524 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-320537f5-67a0-4c24-83a8-0360be6c1804 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:02.072436 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-320537f5-67a0-4c24-83a8-0360be6c1804 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.217126 May 10 03:22:02.073012 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 229/465] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:01 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:02.077871 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-bf8069a7-e34e-43f3-80cb-e3dcb7e448b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:02.078577 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-bf8069a7-e34e-43f3-80cb-e3dcb7e448b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:02.085007 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bf8069a7-e34e-43f3-80cb-e3dcb7e448b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:02.085461 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bf8069a7-e34e-43f3-80cb-e3dcb7e448b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:02.086247 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bf8069a7-e34e-43f3-80cb-e3dcb7e448b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:02.087543 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bf8069a7-e34e-43f3-80cb-e3dcb7e448b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:02.089369 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-03a1f03b-d1ca-4f8f-a9ac-685085a8fcaf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:02.097779 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-03a1f03b-d1ca-4f8f-a9ac-685085a8fcaf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:02.099270 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-03a1f03b-d1ca-4f8f-a9ac-685085a8fcaf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:02.100740 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-03a1f03b-d1ca-4f8f-a9ac-685085a8fcaf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1807 microversion: 2.20 time: 0.209747 May 10 03:22:02.101543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 237/466] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:22:01 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:22:02.157400 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-d7774c8b-5610-4f42-96dd-b141356b3333 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:02.158005 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-d7774c8b-5610-4f42-96dd-b141356b3333 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:02.164756 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d7774c8b-5610-4f42-96dd-b141356b3333 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:02.165209 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d7774c8b-5610-4f42-96dd-b141356b3333 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:02.166245 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d7774c8b-5610-4f42-96dd-b141356b3333 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:02.166816 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d7774c8b-5610-4f42-96dd-b141356b3333 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:02.264418 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-bf8069a7-e34e-43f3-80cb-e3dcb7e448b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:02.272938 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-bf8069a7-e34e-43f3-80cb-e3dcb7e448b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.198830 May 10 03:22:02.284827 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 230/467] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:02 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:02.343882 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-d7774c8b-5610-4f42-96dd-b141356b3333 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:02.352267 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-d7774c8b-5610-4f42-96dd-b141356b3333 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1676 microversion: 2.1 time: 0.198766 May 10 03:22:02.353080 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 238/468] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:02 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1676 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:22:02.844074 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-df5e7236-f91e-4d03-9fed-27ae4340866a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:02.844698 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-df5e7236-f91e-4d03-9fed-27ae4340866a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:02.851392 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-df5e7236-f91e-4d03-9fed-27ae4340866a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:02.851846 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-df5e7236-f91e-4d03-9fed-27ae4340866a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:02.852728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-df5e7236-f91e-4d03-9fed-27ae4340866a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:02.853186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-df5e7236-f91e-4d03-9fed-27ae4340866a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:02.985934 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-df5e7236-f91e-4d03-9fed-27ae4340866a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:02.994009 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-df5e7236-f91e-4d03-9fed-27ae4340866a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1682 microversion: 2.1 time: 0.153889 May 10 03:22:02.994755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 231/469] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:02 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:03.089308 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-7d1392cd-2921-4241-9eab-6cc0d2017e6a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:03.089855 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-7d1392cd-2921-4241-9eab-6cc0d2017e6a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:03.096276 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7d1392cd-2921-4241-9eab-6cc0d2017e6a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:03.096728 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7d1392cd-2921-4241-9eab-6cc0d2017e6a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:03.097502 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7d1392cd-2921-4241-9eab-6cc0d2017e6a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:03.097941 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7d1392cd-2921-4241-9eab-6cc0d2017e6a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:03.119219 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-cca36633-9a12-48d9-abb5-ec10f0975c3b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:03.119740 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-cca36633-9a12-48d9-abb5-ec10f0975c3b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:03.125764 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cca36633-9a12-48d9-abb5-ec10f0975c3b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:03.126222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cca36633-9a12-48d9-abb5-ec10f0975c3b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:03.127005 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cca36633-9a12-48d9-abb5-ec10f0975c3b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:03.127445 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cca36633-9a12-48d9-abb5-ec10f0975c3b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:03.308286 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-7d1392cd-2921-4241-9eab-6cc0d2017e6a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:03.316522 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-7d1392cd-2921-4241-9eab-6cc0d2017e6a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.231167 May 10 03:22:03.326368 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-cca36633-9a12-48d9-abb5-ec10f0975c3b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:03.334456 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 239/470] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:03 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:22:03.334456 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-949b8576-4637-41ed-b5cf-59a71a74537d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:03.334740 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-cca36633-9a12-48d9-abb5-ec10f0975c3b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:03.334865 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-949b8576-4637-41ed-b5cf-59a71a74537d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:03.336256 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-cca36633-9a12-48d9-abb5-ec10f0975c3b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:03.337451 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-cca36633-9a12-48d9-abb5-ec10f0975c3b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1807 microversion: 2.20 time: 0.222720 May 10 03:22:03.338221 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 232/471] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:22:03 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:22:03.342238 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-949b8576-4637-41ed-b5cf-59a71a74537d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:03.342633 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-949b8576-4637-41ed-b5cf-59a71a74537d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:03.343440 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-949b8576-4637-41ed-b5cf-59a71a74537d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:03.343880 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-949b8576-4637-41ed-b5cf-59a71a74537d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:03.372527 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-aa47ce92-1368-41f7-b76c-92c323d71147 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:03.373207 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-aa47ce92-1368-41f7-b76c-92c323d71147 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:03.385203 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-aa47ce92-1368-41f7-b76c-92c323d71147 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:03.386056 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-aa47ce92-1368-41f7-b76c-92c323d71147 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:03.386993 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-aa47ce92-1368-41f7-b76c-92c323d71147 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:03.387425 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-aa47ce92-1368-41f7-b76c-92c323d71147 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:03.546790 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-949b8576-4637-41ed-b5cf-59a71a74537d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:03.555390 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-949b8576-4637-41ed-b5cf-59a71a74537d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.225978 May 10 03:22:03.556285 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 240/472] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:03 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:03.573809 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-aa47ce92-1368-41f7-b76c-92c323d71147 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:03.582934 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-aa47ce92-1368-41f7-b76c-92c323d71147 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1676 microversion: 2.1 time: 0.214119 May 10 03:22:03.583525 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 233/473] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:03 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1676 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:04.012901 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-96c71c04-632d-478d-b000-7d3bf6e18d01 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:04.016038 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-96c71c04-632d-478d-b000-7d3bf6e18d01 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:04.019897 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-96c71c04-632d-478d-b000-7d3bf6e18d01 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:04.020367 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-96c71c04-632d-478d-b000-7d3bf6e18d01 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:04.021134 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-96c71c04-632d-478d-b000-7d3bf6e18d01 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:04.021641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-96c71c04-632d-478d-b000-7d3bf6e18d01 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:04.154116 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-96c71c04-632d-478d-b000-7d3bf6e18d01 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:04.161876 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-96c71c04-632d-478d-b000-7d3bf6e18d01 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1682 microversion: 2.1 time: 0.152683 May 10 03:22:04.162469 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 241/474] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:04 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:04.333913 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-012559bf-32fb-4ad7-8f84-603c55cf66e2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:04.334555 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-012559bf-32fb-4ad7-8f84-603c55cf66e2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:04.342161 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-012559bf-32fb-4ad7-8f84-603c55cf66e2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:04.342605 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-012559bf-32fb-4ad7-8f84-603c55cf66e2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:04.343387 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-012559bf-32fb-4ad7-8f84-603c55cf66e2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:04.343822 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-012559bf-32fb-4ad7-8f84-603c55cf66e2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:04.355832 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-1119928d-2ff6-4730-8d47-451d6930ffc3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:04.356497 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-1119928d-2ff6-4730-8d47-451d6930ffc3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:04.362633 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1119928d-2ff6-4730-8d47-451d6930ffc3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:04.363158 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1119928d-2ff6-4730-8d47-451d6930ffc3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:04.363955 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1119928d-2ff6-4730-8d47-451d6930ffc3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:04.364429 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1119928d-2ff6-4730-8d47-451d6930ffc3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:04.556540 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-012559bf-32fb-4ad7-8f84-603c55cf66e2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:04.564386 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-012559bf-32fb-4ad7-8f84-603c55cf66e2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.234297 May 10 03:22:04.567871 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 234/475] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:04 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:04.583410 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-1119928d-2ff6-4730-8d47-451d6930ffc3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:04.606023 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-ed4c8850-b647-4721-8c3f-690e066f3011 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:04.606023 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-ed4c8850-b647-4721-8c3f-690e066f3011 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:04.606204 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-1119928d-2ff6-4730-8d47-451d6930ffc3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:04.606204 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-1119928d-2ff6-4730-8d47-451d6930ffc3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:04.606204 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-1119928d-2ff6-4730-8d47-451d6930ffc3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1807 microversion: 2.20 time: 0.243150 May 10 03:22:04.607218 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 242/476] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:22:04 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1807 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:22:04.607314 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ed4c8850-b647-4721-8c3f-690e066f3011 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:04.607314 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ed4c8850-b647-4721-8c3f-690e066f3011 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:04.607481 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-cbf82836-14f3-4668-81be-1c4ebc699368 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:04.607481 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-cbf82836-14f3-4668-81be-1c4ebc699368 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:04.607740 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ed4c8850-b647-4721-8c3f-690e066f3011 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:04.607740 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ed4c8850-b647-4721-8c3f-690e066f3011 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:04.611208 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-cbf82836-14f3-4668-81be-1c4ebc699368 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:04.611723 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-cbf82836-14f3-4668-81be-1c4ebc699368 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:04.612745 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-cbf82836-14f3-4668-81be-1c4ebc699368 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:04.613292 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-cbf82836-14f3-4668-81be-1c4ebc699368 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:04.848753 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-cbf82836-14f3-4668-81be-1c4ebc699368 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:04.858485 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-cbf82836-14f3-4668-81be-1c4ebc699368 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1676 microversion: 2.1 time: 0.260946 May 10 03:22:04.859451 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 243/477] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:04 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1676 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:04.864853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ed4c8850-b647-4721-8c3f-690e066f3011 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:04.882738 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-ed4c8850-b647-4721-8c3f-690e066f3011 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.304342 May 10 03:22:04.882738 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 235/478] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:04 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:05.179649 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-444fa5ee-9f77-4907-94ed-32c8f9504664 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:05.180289 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-444fa5ee-9f77-4907-94ed-32c8f9504664 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:05.187881 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-444fa5ee-9f77-4907-94ed-32c8f9504664 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:05.188583 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-444fa5ee-9f77-4907-94ed-32c8f9504664 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:05.189445 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-444fa5ee-9f77-4907-94ed-32c8f9504664 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:05.189953 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-444fa5ee-9f77-4907-94ed-32c8f9504664 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:05.338425 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-444fa5ee-9f77-4907-94ed-32c8f9504664 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:05.346549 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-444fa5ee-9f77-4907-94ed-32c8f9504664 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1682 microversion: 2.1 time: 0.170561 May 10 03:22:05.347141 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 244/479] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:05 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:05.585072 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-7d165f61-98bb-4e97-a154-50b48437b398 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:05.585671 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-7d165f61-98bb-4e97-a154-50b48437b398 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:05.592241 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7d165f61-98bb-4e97-a154-50b48437b398 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:05.592697 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7d165f61-98bb-4e97-a154-50b48437b398 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:05.593473 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7d165f61-98bb-4e97-a154-50b48437b398 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:05.593911 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7d165f61-98bb-4e97-a154-50b48437b398 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:05.614320 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-bc9aebcd-2067-4e0b-8c31-47faf8894a1a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:05.618748 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-bc9aebcd-2067-4e0b-8c31-47faf8894a1a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:05.621030 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bc9aebcd-2067-4e0b-8c31-47faf8894a1a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:05.621488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bc9aebcd-2067-4e0b-8c31-47faf8894a1a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:05.622282 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bc9aebcd-2067-4e0b-8c31-47faf8894a1a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:05.622701 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bc9aebcd-2067-4e0b-8c31-47faf8894a1a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:05.776757 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-7d165f61-98bb-4e97-a154-50b48437b398 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:05.784128 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-7d165f61-98bb-4e97-a154-50b48437b398 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.203444 May 10 03:22:05.784705 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 236/480] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:05 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:05.797264 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-bc9aebcd-2067-4e0b-8c31-47faf8894a1a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:05.805853 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-bc9aebcd-2067-4e0b-8c31-47faf8894a1a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:05.807333 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-bc9aebcd-2067-4e0b-8c31-47faf8894a1a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:05.808503 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-bc9aebcd-2067-4e0b-8c31-47faf8894a1a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1807 microversion: 2.20 time: 0.198141 May 10 03:22:05.809055 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 245/481] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:22:05 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:22:05.875060 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-52bb06dd-eeaf-48b7-9db3-b842df60a59c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:05.875704 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-52bb06dd-eeaf-48b7-9db3-b842df60a59c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:05.882196 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-52bb06dd-eeaf-48b7-9db3-b842df60a59c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:05.882649 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-52bb06dd-eeaf-48b7-9db3-b842df60a59c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:05.883415 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-52bb06dd-eeaf-48b7-9db3-b842df60a59c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:05.883860 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-52bb06dd-eeaf-48b7-9db3-b842df60a59c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:05.890231 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c65b04b8-05e6-4cca-b2b5-99c186c7f5ea tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:05.890828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-c65b04b8-05e6-4cca-b2b5-99c186c7f5ea tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:05.896490 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c65b04b8-05e6-4cca-b2b5-99c186c7f5ea tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:05.897442 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c65b04b8-05e6-4cca-b2b5-99c186c7f5ea tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:05.898201 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c65b04b8-05e6-4cca-b2b5-99c186c7f5ea tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:05.898629 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c65b04b8-05e6-4cca-b2b5-99c186c7f5ea tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:06.074061 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-52bb06dd-eeaf-48b7-9db3-b842df60a59c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:06.077241 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-c65b04b8-05e6-4cca-b2b5-99c186c7f5ea tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:06.081545 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-52bb06dd-eeaf-48b7-9db3-b842df60a59c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1676 microversion: 2.1 time: 0.210248 May 10 03:22:06.082270 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 237/482] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:05 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1676 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:06.085109 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-c65b04b8-05e6-4cca-b2b5-99c186c7f5ea tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.198575 May 10 03:22:06.085674 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 246/483] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:05 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:06.364386 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-f39bf308-034f-40aa-b90a-2db89bd8fdbd tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:06.364995 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-f39bf308-034f-40aa-b90a-2db89bd8fdbd tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:06.371015 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f39bf308-034f-40aa-b90a-2db89bd8fdbd tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:06.371507 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f39bf308-034f-40aa-b90a-2db89bd8fdbd tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:06.372269 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f39bf308-034f-40aa-b90a-2db89bd8fdbd tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:06.372711 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f39bf308-034f-40aa-b90a-2db89bd8fdbd tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:06.507697 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-f39bf308-034f-40aa-b90a-2db89bd8fdbd tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:06.507846 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-f39bf308-034f-40aa-b90a-2db89bd8fdbd tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1682 microversion: 2.1 time: 0.147450 May 10 03:22:06.508376 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 238/484] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:06 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:06.800112 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-6e42ba50-6fd8-4bfe-94c7-674d1847cf8a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:06.800707 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-6e42ba50-6fd8-4bfe-94c7-674d1847cf8a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:06.807096 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6e42ba50-6fd8-4bfe-94c7-674d1847cf8a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:06.807536 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6e42ba50-6fd8-4bfe-94c7-674d1847cf8a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:06.808315 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6e42ba50-6fd8-4bfe-94c7-674d1847cf8a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:06.808748 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6e42ba50-6fd8-4bfe-94c7-674d1847cf8a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:06.826511 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-d8ac04dc-3c00-47c7-be68-a166dfb01816 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:06.827178 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-d8ac04dc-3c00-47c7-be68-a166dfb01816 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:06.833372 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d8ac04dc-3c00-47c7-be68-a166dfb01816 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:06.833819 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d8ac04dc-3c00-47c7-be68-a166dfb01816 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:06.835091 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d8ac04dc-3c00-47c7-be68-a166dfb01816 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:06.835524 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d8ac04dc-3c00-47c7-be68-a166dfb01816 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:07.002986 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-6e42ba50-6fd8-4bfe-94c7-674d1847cf8a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:07.010205 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-d8ac04dc-3c00-47c7-be68-a166dfb01816 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:07.010929 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-6e42ba50-6fd8-4bfe-94c7-674d1847cf8a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.214633 May 10 03:22:07.011511 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 247/485] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:06 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:07.018693 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-d8ac04dc-3c00-47c7-be68-a166dfb01816 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:07.020317 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-d8ac04dc-3c00-47c7-be68-a166dfb01816 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:07.021579 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-d8ac04dc-3c00-47c7-be68-a166dfb01816 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1807 microversion: 2.20 time: 0.198961 May 10 03:22:07.022702 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 239/486] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:22:06 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1807 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:22:07.098613 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-6805e9ba-fc95-4159-88fa-572c45aaa16e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:07.099155 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-6805e9ba-fc95-4159-88fa-572c45aaa16e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:07.101303 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-457a99a5-7d99-4c58-a1cb-698b9e11470c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:07.101906 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-457a99a5-7d99-4c58-a1cb-698b9e11470c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:07.105521 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6805e9ba-fc95-4159-88fa-572c45aaa16e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:07.105977 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6805e9ba-fc95-4159-88fa-572c45aaa16e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:07.106746 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6805e9ba-fc95-4159-88fa-572c45aaa16e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:07.107187 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6805e9ba-fc95-4159-88fa-572c45aaa16e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:07.107579 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-457a99a5-7d99-4c58-a1cb-698b9e11470c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:07.108101 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-457a99a5-7d99-4c58-a1cb-698b9e11470c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:07.108798 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-457a99a5-7d99-4c58-a1cb-698b9e11470c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:07.109229 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-457a99a5-7d99-4c58-a1cb-698b9e11470c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:07.295703 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-6805e9ba-fc95-4159-88fa-572c45aaa16e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:07.298879 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-457a99a5-7d99-4c58-a1cb-698b9e11470c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:07.303704 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-6805e9ba-fc95-4159-88fa-572c45aaa16e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1653 microversion: 2.1 time: 0.208525 May 10 03:22:07.304321 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 248/487] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:07 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1653 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:07.306777 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-457a99a5-7d99-4c58-a1cb-698b9e11470c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.209173 May 10 03:22:07.307342 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 240/488] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:07 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:22:07.319827 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-14cf5fb3-d39f-4de1-9796-3c7f082fdf72 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:07.326286 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-14cf5fb3-d39f-4de1-9796-3c7f082fdf72 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:07.331643 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-14cf5fb3-d39f-4de1-9796-3c7f082fdf72 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:07.355344 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-14cf5fb3-d39f-4de1-9796-3c7f082fdf72 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Going to try to start instance {{(pid=117399) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 03:22:07.525669 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-af2a36dc-ef87-4bf0-bb56-024e052df067 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:07.526305 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-af2a36dc-ef87-4bf0-bb56-024e052df067 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:07.532143 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-af2a36dc-ef87-4bf0-bb56-024e052df067 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:07.532599 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-af2a36dc-ef87-4bf0-bb56-024e052df067 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:07.533372 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-af2a36dc-ef87-4bf0-bb56-024e052df067 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:07.533861 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-af2a36dc-ef87-4bf0-bb56-024e052df067 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:07.616526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-14cf5fb3-d39f-4de1-9796-3c7f082fdf72 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "POST /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13/action" status: 202 len: 0 microversion: 2.1 time: 0.293960 May 10 03:22:07.616526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 249/489] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 03:22:07 2022] POST /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:22:07.619735 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-9c182287-0e03-4d2a-bd79-4dec04da23df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:07.620674 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-9c182287-0e03-4d2a-bd79-4dec04da23df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:07.627349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9c182287-0e03-4d2a-bd79-4dec04da23df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:07.627801 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9c182287-0e03-4d2a-bd79-4dec04da23df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:07.628636 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9c182287-0e03-4d2a-bd79-4dec04da23df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:07.629073 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9c182287-0e03-4d2a-bd79-4dec04da23df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:07.679804 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-af2a36dc-ef87-4bf0-bb56-024e052df067 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:07.689195 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-af2a36dc-ef87-4bf0-bb56-024e052df067 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1682 microversion: 2.1 time: 0.167853 May 10 03:22:07.693046 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 241/490] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:07 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:22:07.763562 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-9c182287-0e03-4d2a-bd79-4dec04da23df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:07.770993 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-9c182287-0e03-4d2a-bd79-4dec04da23df tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1662 microversion: 2.1 time: 0.155488 May 10 03:22:07.771604 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 250/491] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:07 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:08.028999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-432b8a73-d03d-4909-993c-bc26962af3c5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:08.029604 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-432b8a73-d03d-4909-993c-bc26962af3c5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:08.035919 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-432b8a73-d03d-4909-993c-bc26962af3c5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:08.036390 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-432b8a73-d03d-4909-993c-bc26962af3c5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:08.037189 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-432b8a73-d03d-4909-993c-bc26962af3c5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:08.037616 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-432b8a73-d03d-4909-993c-bc26962af3c5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:08.040215 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c0d3dd31-61b9-46ff-b668-af8a4ecdf816 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:08.040823 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-c0d3dd31-61b9-46ff-b668-af8a4ecdf816 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:08.047361 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c0d3dd31-61b9-46ff-b668-af8a4ecdf816 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:08.047817 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c0d3dd31-61b9-46ff-b668-af8a4ecdf816 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:08.048614 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c0d3dd31-61b9-46ff-b668-af8a4ecdf816 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:08.049058 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c0d3dd31-61b9-46ff-b668-af8a4ecdf816 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:08.459643 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-432b8a73-d03d-4909-993c-bc26962af3c5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:08.466975 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-c0d3dd31-61b9-46ff-b668-af8a4ecdf816 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:08.467140 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-432b8a73-d03d-4909-993c-bc26962af3c5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.441935 May 10 03:22:08.467715 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 242/492] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:08 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:22:08.472205 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-1df1e3c6-ed39-411c-b16c-760186d543a7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:08.472720 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-1df1e3c6-ed39-411c-b16c-760186d543a7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:08.476571 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-c0d3dd31-61b9-46ff-b668-af8a4ecdf816 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:08.478219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-c0d3dd31-61b9-46ff-b668-af8a4ecdf816 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:08.478931 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1df1e3c6-ed39-411c-b16c-760186d543a7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:08.479377 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1df1e3c6-ed39-411c-b16c-760186d543a7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:08.479587 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-c0d3dd31-61b9-46ff-b668-af8a4ecdf816 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1807 microversion: 2.20 time: 0.443148 May 10 03:22:08.480184 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1df1e3c6-ed39-411c-b16c-760186d543a7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:08.480310 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 251/493] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:22:08 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1807 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:22:08.480644 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1df1e3c6-ed39-411c-b16c-760186d543a7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:08.607859 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1df1e3c6-ed39-411c-b16c-760186d543a7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:08.615286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-1df1e3c6-ed39-411c-b16c-760186d543a7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.146585 May 10 03:22:08.616571 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 243/494] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:08 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:08.708846 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-f585c71e-dc5a-49c7-8ed3-ec4767c3d6bc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:08.709377 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-f585c71e-dc5a-49c7-8ed3-ec4767c3d6bc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:08.715542 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f585c71e-dc5a-49c7-8ed3-ec4767c3d6bc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:08.715992 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f585c71e-dc5a-49c7-8ed3-ec4767c3d6bc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:08.716839 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f585c71e-dc5a-49c7-8ed3-ec4767c3d6bc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:08.717451 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f585c71e-dc5a-49c7-8ed3-ec4767c3d6bc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:08.789181 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-157d573a-06e1-446d-93f2-eb558ebb1c94 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:08.789817 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-157d573a-06e1-446d-93f2-eb558ebb1c94 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:08.796306 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-157d573a-06e1-446d-93f2-eb558ebb1c94 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:08.801305 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-157d573a-06e1-446d-93f2-eb558ebb1c94 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:08.801305 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-157d573a-06e1-446d-93f2-eb558ebb1c94 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:08.801305 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-157d573a-06e1-446d-93f2-eb558ebb1c94 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:08.879058 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-f585c71e-dc5a-49c7-8ed3-ec4767c3d6bc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:08.886794 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-f585c71e-dc5a-49c7-8ed3-ec4767c3d6bc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1682 microversion: 2.1 time: 0.182004 May 10 03:22:08.887452 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 252/495] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:08 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:08.941238 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-157d573a-06e1-446d-93f2-eb558ebb1c94 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:08.948644 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-157d573a-06e1-446d-93f2-eb558ebb1c94 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1662 microversion: 2.1 time: 0.163996 May 10 03:22:08.949221 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 244/496] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:08 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1662 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:22:09.484333 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-5770d035-001f-4573-b104-c76302bf0fea tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:09.484948 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-5770d035-001f-4573-b104-c76302bf0fea tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:09.491173 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5770d035-001f-4573-b104-c76302bf0fea tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:09.491627 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5770d035-001f-4573-b104-c76302bf0fea tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:09.492640 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5770d035-001f-4573-b104-c76302bf0fea tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:09.492850 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5770d035-001f-4573-b104-c76302bf0fea tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:09.497487 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-cffe673f-7c8e-477c-b526-e981b02a160e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:09.498099 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-cffe673f-7c8e-477c-b526-e981b02a160e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:09.504619 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cffe673f-7c8e-477c-b526-e981b02a160e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:09.505070 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cffe673f-7c8e-477c-b526-e981b02a160e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:09.505859 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cffe673f-7c8e-477c-b526-e981b02a160e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:09.506811 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-cffe673f-7c8e-477c-b526-e981b02a160e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:09.687758 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-5770d035-001f-4573-b104-c76302bf0fea tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:09.696243 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-5770d035-001f-4573-b104-c76302bf0fea tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.215693 May 10 03:22:09.696841 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 253/497] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:09 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:09.701193 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-cffe673f-7c8e-477c-b526-e981b02a160e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:09.701518 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-d6e3f4a3-0aac-456b-b1b4-370448d24867 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:09.702141 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-d6e3f4a3-0aac-456b-b1b4-370448d24867 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:09.708258 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d6e3f4a3-0aac-456b-b1b4-370448d24867 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:09.708718 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d6e3f4a3-0aac-456b-b1b4-370448d24867 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:09.710042 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d6e3f4a3-0aac-456b-b1b4-370448d24867 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:09.710484 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d6e3f4a3-0aac-456b-b1b4-370448d24867 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:09.712555 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-cffe673f-7c8e-477c-b526-e981b02a160e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:09.714821 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-cffe673f-7c8e-477c-b526-e981b02a160e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:09.715609 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-cffe673f-7c8e-477c-b526-e981b02a160e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1807 microversion: 2.20 time: 0.221939 May 10 03:22:09.716578 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 245/498] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:22:09 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1807 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:22:09.843073 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-d6e3f4a3-0aac-456b-b1b4-370448d24867 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:09.851063 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-d6e3f4a3-0aac-456b-b1b4-370448d24867 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.152594 May 10 03:22:09.851579 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 254/499] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:09 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:09.904250 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-755b3f5c-d59b-4fae-b72f-12831cb9eae5 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:09.904951 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-755b3f5c-d59b-4fae-b72f-12831cb9eae5 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:09.910954 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-755b3f5c-d59b-4fae-b72f-12831cb9eae5 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:09.911408 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-755b3f5c-d59b-4fae-b72f-12831cb9eae5 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:09.912200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-755b3f5c-d59b-4fae-b72f-12831cb9eae5 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:09.913971 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-755b3f5c-d59b-4fae-b72f-12831cb9eae5 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:09.966820 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-2d4f541f-59ad-41f1-a339-3b3f781eb627 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:09.967592 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-2d4f541f-59ad-41f1-a339-3b3f781eb627 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:09.973754 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2d4f541f-59ad-41f1-a339-3b3f781eb627 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:09.974444 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2d4f541f-59ad-41f1-a339-3b3f781eb627 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:09.975358 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2d4f541f-59ad-41f1-a339-3b3f781eb627 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:09.975870 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2d4f541f-59ad-41f1-a339-3b3f781eb627 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:09.978008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-755b3f5c-d59b-4fae-b72f-12831cb9eae5 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:09.985640 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-755b3f5c-d59b-4fae-b72f-12831cb9eae5 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1615 microversion: 2.1 time: 0.085269 May 10 03:22:09.986216 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 246/500] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:09 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1615 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:10.126872 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-2d4f541f-59ad-41f1-a339-3b3f781eb627 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:10.142387 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-2d4f541f-59ad-41f1-a339-3b3f781eb627 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1662 microversion: 2.1 time: 0.179282 May 10 03:22:10.142985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 255/501] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:09 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1662 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:10.593446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-e4315f53-44f4-4ca2-ae10-b768267b5402 req-e1b31e5f-04bb-42d7-9edb-fefac32ed662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25e932f1-fc8d-4515-b33f-e1ba788e850b", "name": "network-vif-deleted", "tag": "e00eeae9-db9b-46b3-b858-0190082d908f"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:10.602138 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-e4315f53-44f4-4ca2-ae10-b768267b5402 req-e1b31e5f-04bb-42d7-9edb-fefac32ed662 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:10.602697 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-e4315f53-44f4-4ca2-ae10-b768267b5402 req-e1b31e5f-04bb-42d7-9edb-fefac32ed662 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:10.615295 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-e4315f53-44f4-4ca2-ae10-b768267b5402 req-e1b31e5f-04bb-42d7-9edb-fefac32ed662 service nova] Creating event network-vif-deleted:e00eeae9-db9b-46b3-b858-0190082d908f for instance 25e932f1-fc8d-4515-b33f-e1ba788e850b on hv-cinder-83009 May 10 03:22:10.620943 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-e4315f53-44f4-4ca2-ae10-b768267b5402 req-e1b31e5f-04bb-42d7-9edb-fefac32ed662 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031403 May 10 03:22:10.621625 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 247/502] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:22:10.713499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-946ef365-c78f-408c-87eb-ee40f69466df tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:10.714072 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-946ef365-c78f-408c-87eb-ee40f69466df tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:10.720804 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-946ef365-c78f-408c-87eb-ee40f69466df tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:10.721277 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-946ef365-c78f-408c-87eb-ee40f69466df tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:10.722073 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-946ef365-c78f-408c-87eb-ee40f69466df tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:10.722515 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-946ef365-c78f-408c-87eb-ee40f69466df tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:10.735565 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-16ada269-f087-44a9-bd6b-d16c7c29ab56 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:10.736900 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-16ada269-f087-44a9-bd6b-d16c7c29ab56 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:10.744028 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-16ada269-f087-44a9-bd6b-d16c7c29ab56 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:10.745373 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-16ada269-f087-44a9-bd6b-d16c7c29ab56 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:10.746539 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-16ada269-f087-44a9-bd6b-d16c7c29ab56 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:10.747319 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-16ada269-f087-44a9-bd6b-d16c7c29ab56 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:10.974595 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-16ada269-f087-44a9-bd6b-d16c7c29ab56 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:10.980758 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-946ef365-c78f-408c-87eb-ee40f69466df tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:10.983543 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-16ada269-f087-44a9-bd6b-d16c7c29ab56 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:10.991601 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-946ef365-c78f-408c-87eb-ee40f69466df tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1358 microversion: 2.1 time: 0.282596 May 10 03:22:10.992460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-16ada269-f087-44a9-bd6b-d16c7c29ab56 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:10.993779 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-16ada269-f087-44a9-bd6b-d16c7c29ab56 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1807 microversion: 2.20 time: 0.262918 May 10 03:22:11.003673 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 256/503] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:10 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1358 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:11.004472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 248/504] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:22:10 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1807 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:22:11.009966 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-1762297d-3770-4b44-bed7-5a85d941163c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:11.010592 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-8b5d4368-0874-4cac-afdf-52618e7df3af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:11.011050 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-1762297d-3770-4b44-bed7-5a85d941163c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:11.011390 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8b5d4368-0874-4cac-afdf-52618e7df3af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:11.024309 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8b5d4368-0874-4cac-afdf-52618e7df3af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:11.024902 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8b5d4368-0874-4cac-afdf-52618e7df3af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:11.026087 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8b5d4368-0874-4cac-afdf-52618e7df3af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:11.026777 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8b5d4368-0874-4cac-afdf-52618e7df3af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:11.030213 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1762297d-3770-4b44-bed7-5a85d941163c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:11.031047 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1762297d-3770-4b44-bed7-5a85d941163c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:11.031932 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1762297d-3770-4b44-bed7-5a85d941163c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:11.032488 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1762297d-3770-4b44-bed7-5a85d941163c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:11.128264 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1762297d-3770-4b44-bed7-5a85d941163c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:11.144385 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-1762297d-3770-4b44-bed7-5a85d941163c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1615 microversion: 2.1 time: 0.131949 May 10 03:22:11.145749 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 249/505] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:11 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1615 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:11.159299 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-31f0c2ad-9694-47cc-8563-8301381e86cc tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:11.160330 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-31f0c2ad-9694-47cc-8563-8301381e86cc tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:11.172878 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-31f0c2ad-9694-47cc-8563-8301381e86cc tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:11.178794 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-31f0c2ad-9694-47cc-8563-8301381e86cc tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:11.178794 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-31f0c2ad-9694-47cc-8563-8301381e86cc tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:11.178794 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-31f0c2ad-9694-47cc-8563-8301381e86cc tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:11.328332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8b5d4368-0874-4cac-afdf-52618e7df3af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:11.342750 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-8b5d4368-0874-4cac-afdf-52618e7df3af tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1371 microversion: 2.1 time: 0.337317 May 10 03:22:11.343775 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 257/506] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:11 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1371 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:11.362801 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-31f0c2ad-9694-47cc-8563-8301381e86cc tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:11.372287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-31f0c2ad-9694-47cc-8563-8301381e86cc tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1662 microversion: 2.1 time: 0.216630 May 10 03:22:11.373152 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 250/507] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:11 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1662 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:22:12.013565 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-518cac34-95c5-4b36-b2e6-820822c46b2f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:12.014187 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-518cac34-95c5-4b36-b2e6-820822c46b2f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:12.015596 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-926e1d3d-4c74-4c97-9df0-684b89e5069b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:12.017471 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-926e1d3d-4c74-4c97-9df0-684b89e5069b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:12.031653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-518cac34-95c5-4b36-b2e6-820822c46b2f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:12.032208 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-518cac34-95c5-4b36-b2e6-820822c46b2f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:12.032990 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-518cac34-95c5-4b36-b2e6-820822c46b2f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:12.033610 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-518cac34-95c5-4b36-b2e6-820822c46b2f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:12.034802 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-926e1d3d-4c74-4c97-9df0-684b89e5069b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:12.038397 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-926e1d3d-4c74-4c97-9df0-684b89e5069b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:12.038397 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-926e1d3d-4c74-4c97-9df0-684b89e5069b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:12.038397 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-926e1d3d-4c74-4c97-9df0-684b89e5069b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:12.269104 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-926e1d3d-4c74-4c97-9df0-684b89e5069b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:12.279406 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-926e1d3d-4c74-4c97-9df0-684b89e5069b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1548 microversion: 2.1 time: 0.272956 May 10 03:22:12.280474 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 258/508] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:12 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1548 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:12.286465 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-25f28fcd-8318-4e90-af56-ec7039352953 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:12.287068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-25f28fcd-8318-4e90-af56-ec7039352953 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:12.308028 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-25f28fcd-8318-4e90-af56-ec7039352953 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:12.308584 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-25f28fcd-8318-4e90-af56-ec7039352953 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:12.308871 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-518cac34-95c5-4b36-b2e6-820822c46b2f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:12.309775 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-25f28fcd-8318-4e90-af56-ec7039352953 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:12.312585 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-25f28fcd-8318-4e90-af56-ec7039352953 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:12.318061 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-518cac34-95c5-4b36-b2e6-820822c46b2f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:12.319616 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-518cac34-95c5-4b36-b2e6-820822c46b2f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:12.320832 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-518cac34-95c5-4b36-b2e6-820822c46b2f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1807 microversion: 2.20 time: 0.311450 May 10 03:22:12.321404 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 251/509] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:22:12 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1807 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:22:12.336455 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-5ae266f0-cfa4-4bd9-b781-47d965f773dd tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:12.337994 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-5ae266f0-cfa4-4bd9-b781-47d965f773dd tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:12.344809 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5ae266f0-cfa4-4bd9-b781-47d965f773dd tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:12.354272 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5ae266f0-cfa4-4bd9-b781-47d965f773dd tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:12.360413 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5ae266f0-cfa4-4bd9-b781-47d965f773dd tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:12.361095 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5ae266f0-cfa4-4bd9-b781-47d965f773dd tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:12.376799 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-25f28fcd-8318-4e90-af56-ec7039352953 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:12.377249 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-25f28fcd-8318-4e90-af56-ec7039352953 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:12.377694 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.objects.instance [None req-25f28fcd-8318-4e90-af56-ec7039352953 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lazy-loading 'fault' on Instance uuid 25e932f1-fc8d-4515-b33f-e1ba788e850b {{(pid=117399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:22:12.468146 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-25f28fcd-8318-4e90-af56-ec7039352953 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:12.478450 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-25f28fcd-8318-4e90-af56-ec7039352953 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1332 microversion: 2.1 time: 0.195566 May 10 03:22:12.479048 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 259/510] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:12 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1332 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:12.504035 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-b5b9bb0d-a730-4cab-a784-4428216525f3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:12.504865 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-b5b9bb0d-a730-4cab-a784-4428216525f3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:12.519815 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b5b9bb0d-a730-4cab-a784-4428216525f3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:12.520336 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b5b9bb0d-a730-4cab-a784-4428216525f3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:12.521171 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b5b9bb0d-a730-4cab-a784-4428216525f3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:12.521616 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b5b9bb0d-a730-4cab-a784-4428216525f3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:12.590031 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5ae266f0-cfa4-4bd9-b781-47d965f773dd tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:12.592486 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-5ae266f0-cfa4-4bd9-b781-47d965f773dd tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1548 microversion: 2.1 time: 0.259448 May 10 03:22:12.593337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 252/511] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:12 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1548 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:12.598104 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-123dc0fa-e87b-4734-8669-2cd76c324c98 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:12.599252 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-123dc0fa-e87b-4734-8669-2cd76c324c98 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:12.607216 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-123dc0fa-e87b-4734-8669-2cd76c324c98 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:12.607887 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-123dc0fa-e87b-4734-8669-2cd76c324c98 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:12.609465 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-123dc0fa-e87b-4734-8669-2cd76c324c98 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:12.610053 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-123dc0fa-e87b-4734-8669-2cd76c324c98 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:12.788697 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-b5b9bb0d-a730-4cab-a784-4428216525f3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:12.803540 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-123dc0fa-e87b-4734-8669-2cd76c324c98 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:12.808183 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-b5b9bb0d-a730-4cab-a784-4428216525f3 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1565 microversion: 2.1 time: 0.315586 May 10 03:22:12.812869 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-123dc0fa-e87b-4734-8669-2cd76c324c98 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1662 microversion: 2.1 time: 0.218672 May 10 03:22:12.813450 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 253/512] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:12 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1662 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:12.818374 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 260/513] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:12 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1565 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:12.822325 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-0b32f5cd-256c-4b9d-868d-a5d54cc645bf tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:12.825969 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-0b32f5cd-256c-4b9d-868d-a5d54cc645bf tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:12.826728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-0b32f5cd-256c-4b9d-868d-a5d54cc645bf tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Searching by: {'deleted': False, 'project_id': 'c5f50448e3cc4533a5c70bb766559548'} {{(pid=117400) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 03:22:12.833313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0b32f5cd-256c-4b9d-868d-a5d54cc645bf tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:12.833459 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-5cd47586-1de8-467e-a8e6-2d33b88acab7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:12.833753 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0b32f5cd-256c-4b9d-868d-a5d54cc645bf tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:12.833990 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-5cd47586-1de8-467e-a8e6-2d33b88acab7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:12.835086 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0b32f5cd-256c-4b9d-868d-a5d54cc645bf tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:12.835518 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0b32f5cd-256c-4b9d-868d-a5d54cc645bf tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:12.840521 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5cd47586-1de8-467e-a8e6-2d33b88acab7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:12.840973 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5cd47586-1de8-467e-a8e6-2d33b88acab7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:12.841806 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5cd47586-1de8-467e-a8e6-2d33b88acab7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:12.842282 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5cd47586-1de8-467e-a8e6-2d33b88acab7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:12.926085 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-5cd47586-1de8-467e-a8e6-2d33b88acab7 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096357 May 10 03:22:12.926871 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 261/514] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 10 03:22:12 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:22:12.933252 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.multi_cell_list [None req-0b32f5cd-256c-4b9d-868d-a5d54cc645bf tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117400) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 03:22:13.032367 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-0b32f5cd-256c-4b9d-868d-a5d54cc645bf tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.213783 May 10 03:22:13.033912 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 254/515] 10.222.0.65 () {58 vars in 1124 bytes} [Tue May 10 03:22:12 2022] GET /compute/v2.1/servers => generated 342 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:22:13.045513 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-3a28b57d-16c9-40e9-9b62-24b47bc4111b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:13.046902 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-3a28b57d-16c9-40e9-9b62-24b47bc4111b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:13.053023 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3a28b57d-16c9-40e9-9b62-24b47bc4111b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:13.054132 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3a28b57d-16c9-40e9-9b62-24b47bc4111b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:13.055172 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3a28b57d-16c9-40e9-9b62-24b47bc4111b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:13.055757 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3a28b57d-16c9-40e9-9b62-24b47bc4111b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:13.211887 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-3a28b57d-16c9-40e9-9b62-24b47bc4111b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:13.219506 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-3a28b57d-16c9-40e9-9b62-24b47bc4111b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1548 microversion: 2.1 time: 0.178667 May 10 03:22:13.220304 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 262/516] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:13 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1548 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:13.339461 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a9e5621d-bdd8-4a22-89fb-4a70de6d7f7c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:13.340422 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-a9e5621d-bdd8-4a22-89fb-4a70de6d7f7c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:13.346675 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a9e5621d-bdd8-4a22-89fb-4a70de6d7f7c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:13.348174 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a9e5621d-bdd8-4a22-89fb-4a70de6d7f7c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:13.348747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a9e5621d-bdd8-4a22-89fb-4a70de6d7f7c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:13.349408 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a9e5621d-bdd8-4a22-89fb-4a70de6d7f7c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:13.495218 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-57de24ad-4456-4e06-8cc0-86cc77a74770 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:13.495941 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-57de24ad-4456-4e06-8cc0-86cc77a74770 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:13.502968 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-a9e5621d-bdd8-4a22-89fb-4a70de6d7f7c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:13.503334 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-57de24ad-4456-4e06-8cc0-86cc77a74770 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:13.504038 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-57de24ad-4456-4e06-8cc0-86cc77a74770 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:13.505007 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-57de24ad-4456-4e06-8cc0-86cc77a74770 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:13.505839 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-57de24ad-4456-4e06-8cc0-86cc77a74770 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:13.511202 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-a9e5621d-bdd8-4a22-89fb-4a70de6d7f7c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:13.512782 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-a9e5621d-bdd8-4a22-89fb-4a70de6d7f7c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:13.513981 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-a9e5621d-bdd8-4a22-89fb-4a70de6d7f7c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1807 microversion: 2.20 time: 0.178473 May 10 03:22:13.514551 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 255/517] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:22:13 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:22:13.543434 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-57de24ad-4456-4e06-8cc0-86cc77a74770 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:13.543885 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-57de24ad-4456-4e06-8cc0-86cc77a74770 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:13.545336 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.objects.instance [None req-57de24ad-4456-4e06-8cc0-86cc77a74770 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lazy-loading 'fault' on Instance uuid 25e932f1-fc8d-4515-b33f-e1ba788e850b {{(pid=117399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:22:13.614112 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-57de24ad-4456-4e06-8cc0-86cc77a74770 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:13.623089 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-57de24ad-4456-4e06-8cc0-86cc77a74770 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 200 len: 1332 microversion: 2.1 time: 0.132169 May 10 03:22:13.623729 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 263/518] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:13 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 1332 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:22:13.833956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-3ff0f317-376c-4eb2-89cb-c90b85871775 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:13.833956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-3ff0f317-376c-4eb2-89cb-c90b85871775 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:13.837031 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3ff0f317-376c-4eb2-89cb-c90b85871775 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:13.837580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3ff0f317-376c-4eb2-89cb-c90b85871775 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:13.838432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3ff0f317-376c-4eb2-89cb-c90b85871775 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:13.838946 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3ff0f317-376c-4eb2-89cb-c90b85871775 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:13.918248 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-7cdb651c-14f8-42d4-97ea-92832a55ebab req-0094ba93-3807-4cd5-9f15-83f59adbc5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8796004-8adb-4534-a094-c62dfd2a9636", "name": "network-vif-plugged", "status": "completed", "tag": "373a71b7-374a-4584-ad6b-1d09a234ef37"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:13.944659 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-7cdb651c-14f8-42d4-97ea-92832a55ebab req-0094ba93-3807-4cd5-9f15-83f59adbc5e8 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:13.946720 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-7cdb651c-14f8-42d4-97ea-92832a55ebab req-0094ba93-3807-4cd5-9f15-83f59adbc5e8 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:13.983919 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-7cdb651c-14f8-42d4-97ea-92832a55ebab req-0094ba93-3807-4cd5-9f15-83f59adbc5e8 service nova] Creating event network-vif-plugged:373a71b7-374a-4584-ad6b-1d09a234ef37 for instance e8796004-8adb-4534-a094-c62dfd2a9636 on hv-cinder-83009 May 10 03:22:13.989365 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-7cdb651c-14f8-42d4-97ea-92832a55ebab req-0094ba93-3807-4cd5-9f15-83f59adbc5e8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075374 May 10 03:22:13.991359 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 264/519] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:22:14.091384 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-3ff0f317-376c-4eb2-89cb-c90b85871775 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:14.107209 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-3ff0f317-376c-4eb2-89cb-c90b85871775 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1666 microversion: 2.1 time: 0.273524 May 10 03:22:14.110705 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 256/520] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:13 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1666 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:14.215379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-bc7e9234-55dc-4b1c-a2fc-64651fa99d4b req-728d6655-fbab-485c-95af-0033d8e42498 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a010d765-8dc4-44a9-922a-feabd172565b", "tag": "3d3f8b1a-cfaf-4bd6-babb-ab9bd3c7b319"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:14.224118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-bc7e9234-55dc-4b1c-a2fc-64651fa99d4b req-728d6655-fbab-485c-95af-0033d8e42498 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:14.224670 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-bc7e9234-55dc-4b1c-a2fc-64651fa99d4b req-728d6655-fbab-485c-95af-0033d8e42498 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:14.237757 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-bc7e9234-55dc-4b1c-a2fc-64651fa99d4b req-728d6655-fbab-485c-95af-0033d8e42498 service nova] Creating event network-changed:3d3f8b1a-cfaf-4bd6-babb-ab9bd3c7b319 for instance a010d765-8dc4-44a9-922a-feabd172565b on hv-cinder-83009 May 10 03:22:14.243317 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-bc7e9234-55dc-4b1c-a2fc-64651fa99d4b req-728d6655-fbab-485c-95af-0033d8e42498 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032094 May 10 03:22:14.244137 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 265/521] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:22:14.537686 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-5aaf100f-7423-4d60-8529-c2abfabfa8e5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:14.539709 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-5aaf100f-7423-4d60-8529-c2abfabfa8e5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:14.557341 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5aaf100f-7423-4d60-8529-c2abfabfa8e5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:14.557798 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5aaf100f-7423-4d60-8529-c2abfabfa8e5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:14.558585 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5aaf100f-7423-4d60-8529-c2abfabfa8e5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:14.559044 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5aaf100f-7423-4d60-8529-c2abfabfa8e5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:14.642593 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-6e58ec8d-e77c-433c-98bd-0cb7adcb9bb0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:14.643632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-6e58ec8d-e77c-433c-98bd-0cb7adcb9bb0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:14.658683 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6e58ec8d-e77c-433c-98bd-0cb7adcb9bb0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:14.659151 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6e58ec8d-e77c-433c-98bd-0cb7adcb9bb0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:14.659949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6e58ec8d-e77c-433c-98bd-0cb7adcb9bb0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:14.660450 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6e58ec8d-e77c-433c-98bd-0cb7adcb9bb0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:14.693647 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-6e58ec8d-e77c-433c-98bd-0cb7adcb9bb0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] HTTP exception thrown: Instance 25e932f1-fc8d-4515-b33f-e1ba788e850b could not be found. May 10 03:22:14.696517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-6e58ec8d-e77c-433c-98bd-0cb7adcb9bb0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Request method failure captured: May 10 03:22:14.696517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b HTTP/1.1 May 10 03:22:14.696517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:22:14.696517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:22:14.696517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:22:14.696517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:22:14.696517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:22:14.696517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:22:14.696517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:22:14.696517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:22:14.696517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedm7QRYCgCmNpOHEq-xocEssXcoKFt3Cw-xUSJVkpdbWkcE2a4swkD5OOWo0sIcmaGXBYMa4anhP-9-xwsnmr7TD0HDae0_ZejhV9Z7LARWPFLjL5ozyZp775dsZG_BfqUR5n4ZQlWeOoqrl2-8Sk1TTVheuLGMVx-c_z5Xm6ARd90Q May 10 03:22:14.696517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:22:14.696517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:22:14.696517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:22:14.696517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:22:14.696517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:22:14.696517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:22:14.696517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:22:14.696517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:22:14.696517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:22:14.696517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:22:14.698084 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b7c607953b94c02977d60c0b0536e24", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b7c607953b94c02977d60c0b0536e24"}]}] May 10 03:22:14.698084 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:22:14.698084 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:22:14.698084 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:22:14.698084 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:22:14.698084 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:22:14.698084 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:22:14.698084 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: 9407e88fdbd74ba196ffd9fd221e15f5 May 10 03:22:14.698084 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:22:14.698084 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: > May 10 03:22:14.698084 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Instance 25e932f1-fc8d-4515-b33f-e1ba788e850b could not be found. May 10 03:22:14.698084 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': '25e932f1-fc8d-4515-b33f-e1ba788e850b'} May 10 03:22:14.698919 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:22:14.698919 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:22:14.698919 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:22:14.698919 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:22:14.698919 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:22:14.698919 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:22:14.698919 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:22:14.698919 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:22:14.698919 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:22:14.698919 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:22:14.698919 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25e932f1-fc8d-4515-b33f-e1ba788e850b could not be found. May 10 03:22:14.698919 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:22:14.698919 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:22:14.698919 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:22:14.698919 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:22:14.698919 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:22:14.698919 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:22:14.698919 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:22:14.698919 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:22:14.698919 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:22:14.700446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:22:14.700446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:22:14.700446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:22:14.700446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:22:14.700446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:22:14.700446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:22:14.700446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:22:14.700446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25e932f1-fc8d-4515-b33f-e1ba788e850b could not be found. May 10 03:22:14.700446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:22:14.700446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:22:14.700446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:22:14.700446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:22:14.700446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:22:14.700446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:22:14.700446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:22:14.700446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:22:14.700446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25e932f1-fc8d-4515-b33f-e1ba788e850b could not be found. May 10 03:22:14.700446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:22:14.701718 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-6e58ec8d-e77c-433c-98bd-0cb7adcb9bb0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Returning 404 to user: Instance 25e932f1-fc8d-4515-b33f-e1ba788e850b could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:22:14.701718 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-6e58ec8d-e77c-433c-98bd-0cb7adcb9bb0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 404 len: 111 microversion: 2.1 time: 0.060999 May 10 03:22:14.702441 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 266/522] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:14 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:22:14.716381 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-61c2dd21-5e02-4076-836f-fd44e2f28a63 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '.version_select at 0x7f6a5dca7550>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:14.760596 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5aaf100f-7423-4d60-8529-c2abfabfa8e5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:14.772618 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5aaf100f-7423-4d60-8529-c2abfabfa8e5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:14.774034 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5aaf100f-7423-4d60-8529-c2abfabfa8e5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:14.775210 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-5aaf100f-7423-4d60-8529-c2abfabfa8e5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1807 microversion: 2.20 time: 0.245639 May 10 03:22:14.775894 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 257/523] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:22:14 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:22:14.793586 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-61c2dd21-5e02-4076-836f-fd44e2f28a63 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1153280867" status: 202 len: 0 microversion: 2.1 time: 0.090021 May 10 03:22:14.794177 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 267/524] 10.222.0.65 () {58 vars in 1220 bytes} [Tue May 10 03:22:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1153280867 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:22:15.220231 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-e8bc52d6-1376-4c0b-8096-93f9655c8f71 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d452dc7d-855e-4eb0-9b09-2343afca56b7"}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:15.221305 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-e8bc52d6-1376-4c0b-8096-93f9655c8f71 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:15.227446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e8bc52d6-1376-4c0b-8096-93f9655c8f71 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:15.227765 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e8bc52d6-1376-4c0b-8096-93f9655c8f71 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:15.228531 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e8bc52d6-1376-4c0b-8096-93f9655c8f71 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:15.228970 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e8bc52d6-1376-4c0b-8096-93f9655c8f71 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:15.794580 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-03231ae0-a177-40b5-9cc6-2620c295190c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:15.795175 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-03231ae0-a177-40b5-9cc6-2620c295190c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:15.801873 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-03231ae0-a177-40b5-9cc6-2620c295190c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:15.802352 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-03231ae0-a177-40b5-9cc6-2620c295190c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:15.803121 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-03231ae0-a177-40b5-9cc6-2620c295190c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:15.803556 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-03231ae0-a177-40b5-9cc6-2620c295190c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:15.956105 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-03231ae0-a177-40b5-9cc6-2620c295190c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:15.965153 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-03231ae0-a177-40b5-9cc6-2620c295190c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:15.966639 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-03231ae0-a177-40b5-9cc6-2620c295190c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:15.967787 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-03231ae0-a177-40b5-9cc6-2620c295190c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1807 microversion: 2.20 time: 0.178033 May 10 03:22:15.968385 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 268/525] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:22:15 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:22:16.011545 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-d12bcce0-6164-4305-ba46-5e5104348be2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:16.012068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-d12bcce0-6164-4305-ba46-5e5104348be2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:16.017958 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d12bcce0-6164-4305-ba46-5e5104348be2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:16.018412 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d12bcce0-6164-4305-ba46-5e5104348be2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:16.019180 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d12bcce0-6164-4305-ba46-5e5104348be2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:16.019617 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d12bcce0-6164-4305-ba46-5e5104348be2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:16.103416 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.objects.instance [None req-d12bcce0-6164-4305-ba46-5e5104348be2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lazy-loading 'services' on Instance uuid a275173c-51a6-4cc6-aef2-b30bcee8b67b {{(pid=117399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:22:16.312384 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-d12bcce0-6164-4305-ba46-5e5104348be2 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b/os-volume_attachments/bc46e0f6-ea49-48d7-9af0-6488aec07e24" status: 202 len: 0 microversion: 2.1 time: 0.304393 May 10 03:22:16.312981 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 269/526] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 10 03:22:16 2022] DELETE /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b/os-volume_attachments/bc46e0f6-ea49-48d7-9af0-6488aec07e24 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:22:16.322152 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-15579706-140c-406f-ae03-ff63450792ac tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:16.323145 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-15579706-140c-406f-ae03-ff63450792ac tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:16.329252 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-15579706-140c-406f-ae03-ff63450792ac tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:16.329703 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-15579706-140c-406f-ae03-ff63450792ac tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:16.330468 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-15579706-140c-406f-ae03-ff63450792ac tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:16.330908 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-15579706-140c-406f-ae03-ff63450792ac tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:16.334380 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-e8bc52d6-1376-4c0b-8096-93f9655c8f71 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "POST /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.117897 May 10 03:22:16.336040 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 258/527] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 03:22:15 2022] POST /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b/os-volume_attachments => generated 194 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:22:16.360102 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-15579706-140c-406f-ae03-ff63450792ac tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042558 May 10 03:22:16.360643 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 270/528] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 03:22:16 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:22:16.986680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-3302d2d9-f93d-4e09-b2f5-5d3383da5edb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:16.987364 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-3302d2d9-f93d-4e09-b2f5-5d3383da5edb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:16.993686 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3302d2d9-f93d-4e09-b2f5-5d3383da5edb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:16.994132 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3302d2d9-f93d-4e09-b2f5-5d3383da5edb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:16.994885 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3302d2d9-f93d-4e09-b2f5-5d3383da5edb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:16.995325 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3302d2d9-f93d-4e09-b2f5-5d3383da5edb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:17.123698 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-3302d2d9-f93d-4e09-b2f5-5d3383da5edb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:17.132738 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-3302d2d9-f93d-4e09-b2f5-5d3383da5edb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:17.134231 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-3302d2d9-f93d-4e09-b2f5-5d3383da5edb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:17.135388 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-3302d2d9-f93d-4e09-b2f5-5d3383da5edb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1807 microversion: 2.20 time: 0.153416 May 10 03:22:17.135954 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 259/529] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:22:16 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:22:17.377461 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ca184d22-c760-49e3-9689-5729f18b8c33 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:17.378409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ca184d22-c760-49e3-9689-5729f18b8c33 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:17.385230 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ca184d22-c760-49e3-9689-5729f18b8c33 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:17.385678 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ca184d22-c760-49e3-9689-5729f18b8c33 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:17.386433 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ca184d22-c760-49e3-9689-5729f18b8c33 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:17.386864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ca184d22-c760-49e3-9689-5729f18b8c33 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:17.417277 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ca184d22-c760-49e3-9689-5729f18b8c33 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043818 May 10 03:22:17.417859 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 271/530] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 03:22:17 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:22:18.153171 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-48fc6c8b-86f6-441b-9990-8c0c044ef8da tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:18.153782 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-48fc6c8b-86f6-441b-9990-8c0c044ef8da tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:18.160568 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-48fc6c8b-86f6-441b-9990-8c0c044ef8da tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:18.161032 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-48fc6c8b-86f6-441b-9990-8c0c044ef8da tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:18.161873 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-48fc6c8b-86f6-441b-9990-8c0c044ef8da tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:18.162349 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-48fc6c8b-86f6-441b-9990-8c0c044ef8da tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:18.301178 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-48fc6c8b-86f6-441b-9990-8c0c044ef8da tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:18.310317 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-48fc6c8b-86f6-441b-9990-8c0c044ef8da tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:18.311814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-48fc6c8b-86f6-441b-9990-8c0c044ef8da tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:18.324093 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-48fc6c8b-86f6-441b-9990-8c0c044ef8da tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1807 microversion: 2.20 time: 0.163685 May 10 03:22:18.324093 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 260/531] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:22:18 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:22:18.427983 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ce3aeb1f-98b1-4f5c-90b1-81a99b7f8103 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:18.429521 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ce3aeb1f-98b1-4f5c-90b1-81a99b7f8103 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:18.436128 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ce3aeb1f-98b1-4f5c-90b1-81a99b7f8103 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:18.436641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ce3aeb1f-98b1-4f5c-90b1-81a99b7f8103 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:18.437422 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ce3aeb1f-98b1-4f5c-90b1-81a99b7f8103 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:18.437868 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ce3aeb1f-98b1-4f5c-90b1-81a99b7f8103 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:18.467338 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ce3aeb1f-98b1-4f5c-90b1-81a99b7f8103 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043251 May 10 03:22:18.472276 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 272/532] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 03:22:18 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:22:18.530179 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-d14dfbd6-0487-4c65-8962-859eda08780c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:18.530676 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-d14dfbd6-0487-4c65-8962-859eda08780c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:18.536437 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d14dfbd6-0487-4c65-8962-859eda08780c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:18.536889 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d14dfbd6-0487-4c65-8962-859eda08780c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:18.538320 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d14dfbd6-0487-4c65-8962-859eda08780c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:18.538761 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d14dfbd6-0487-4c65-8962-859eda08780c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:18.562925 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-d14dfbd6-0487-4c65-8962-859eda08780c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Going to try to terminate instance {{(pid=117400) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:22:18.884767 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-d14dfbd6-0487-4c65-8962-859eda08780c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 204 len: 0 microversion: 2.1 time: 0.358105 May 10 03:22:18.885358 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 261/533] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:22:18 2022] DELETE /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:22:18.893602 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-3838cb65-ddd4-4ea5-b2bd-bd2595f1c1f0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:18.894215 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-3838cb65-ddd4-4ea5-b2bd-bd2595f1c1f0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:18.900671 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3838cb65-ddd4-4ea5-b2bd-bd2595f1c1f0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:18.901185 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3838cb65-ddd4-4ea5-b2bd-bd2595f1c1f0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:18.901882 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3838cb65-ddd4-4ea5-b2bd-bd2595f1c1f0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:18.902321 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3838cb65-ddd4-4ea5-b2bd-bd2595f1c1f0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:19.032498 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-3838cb65-ddd4-4ea5-b2bd-bd2595f1c1f0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:19.039846 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-3838cb65-ddd4-4ea5-b2bd-bd2595f1c1f0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1680 microversion: 2.1 time: 0.150274 May 10 03:22:19.040442 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 273/534] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:18 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:19.332023 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-1b458bd9-75a3-4b7a-a2bf-e65f7b6f5543 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:19.339086 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-1b458bd9-75a3-4b7a-a2bf-e65f7b6f5543 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:19.339273 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1b458bd9-75a3-4b7a-a2bf-e65f7b6f5543 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:19.339798 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1b458bd9-75a3-4b7a-a2bf-e65f7b6f5543 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:19.340611 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1b458bd9-75a3-4b7a-a2bf-e65f7b6f5543 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:19.341050 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1b458bd9-75a3-4b7a-a2bf-e65f7b6f5543 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:19.471544 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1b458bd9-75a3-4b7a-a2bf-e65f7b6f5543 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:19.480083 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1b458bd9-75a3-4b7a-a2bf-e65f7b6f5543 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:19.481588 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1b458bd9-75a3-4b7a-a2bf-e65f7b6f5543 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:19.482729 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-1b458bd9-75a3-4b7a-a2bf-e65f7b6f5543 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1794 microversion: 2.20 time: 0.155008 May 10 03:22:19.483280 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 262/535] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:22:19 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1794 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:22:20.057649 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-9cab3de9-4d90-46a6-8076-3e1dbeb5bbaa tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:20.058266 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-9cab3de9-4d90-46a6-8076-3e1dbeb5bbaa tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:20.064638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9cab3de9-4d90-46a6-8076-3e1dbeb5bbaa tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:20.065090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9cab3de9-4d90-46a6-8076-3e1dbeb5bbaa tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:20.065861 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9cab3de9-4d90-46a6-8076-3e1dbeb5bbaa tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:20.066301 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9cab3de9-4d90-46a6-8076-3e1dbeb5bbaa tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:20.198360 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-9cab3de9-4d90-46a6-8076-3e1dbeb5bbaa tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:20.205623 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-9cab3de9-4d90-46a6-8076-3e1dbeb5bbaa tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1680 microversion: 2.1 time: 0.151868 May 10 03:22:20.206180 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 274/536] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:20 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:21.222957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-8c793b66-1548-4831-be5d-4be6d73d87ab tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:21.227856 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-8c793b66-1548-4831-be5d-4be6d73d87ab tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:21.229984 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8c793b66-1548-4831-be5d-4be6d73d87ab tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:21.230435 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8c793b66-1548-4831-be5d-4be6d73d87ab tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:21.231212 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8c793b66-1548-4831-be5d-4be6d73d87ab tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:21.231655 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8c793b66-1548-4831-be5d-4be6d73d87ab tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:21.294567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-8c793b66-1548-4831-be5d-4be6d73d87ab tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:21.302059 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-8c793b66-1548-4831-be5d-4be6d73d87ab tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1613 microversion: 2.1 time: 0.083025 May 10 03:22:21.302631 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 263/537] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:21 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1613 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:21.485175 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-e6400300-4b52-4d8d-8de1-e30345cd1fe9 req-3d4317a8-ead4-41fe-8e6f-8f2805460ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a275173c-51a6-4cc6-aef2-b30bcee8b67b", "name": "network-vif-deleted", "tag": "3675090a-d6b4-4972-9846-20ea88eb78e8"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:21.495961 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-e6400300-4b52-4d8d-8de1-e30345cd1fe9 req-3d4317a8-ead4-41fe-8e6f-8f2805460ea6 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:21.496439 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-e6400300-4b52-4d8d-8de1-e30345cd1fe9 req-3d4317a8-ead4-41fe-8e6f-8f2805460ea6 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:21.508303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-e6400300-4b52-4d8d-8de1-e30345cd1fe9 req-3d4317a8-ead4-41fe-8e6f-8f2805460ea6 service nova] Creating event network-vif-deleted:3675090a-d6b4-4972-9846-20ea88eb78e8 for instance a275173c-51a6-4cc6-aef2-b30bcee8b67b on hv-cinder-83009 May 10 03:22:21.513654 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-e6400300-4b52-4d8d-8de1-e30345cd1fe9 req-3d4317a8-ead4-41fe-8e6f-8f2805460ea6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032433 May 10 03:22:21.514327 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 275/538] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:22:21.806600 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-059781d5-153b-41e0-b58f-53af55a7276d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:21.807136 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-059781d5-153b-41e0-b58f-53af55a7276d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:21.813405 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-059781d5-153b-41e0-b58f-53af55a7276d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:21.813853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-059781d5-153b-41e0-b58f-53af55a7276d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:21.814816 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-059781d5-153b-41e0-b58f-53af55a7276d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:21.815257 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-059781d5-153b-41e0-b58f-53af55a7276d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:21.953656 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-059781d5-153b-41e0-b58f-53af55a7276d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:21.961789 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-059781d5-153b-41e0-b58f-53af55a7276d tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1594 microversion: 2.1 time: 0.159812 May 10 03:22:21.962368 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 264/539] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:21 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1594 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:22:22.319641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-d2b990de-80da-47f7-8c89-a7b8c597107b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:22.320326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-d2b990de-80da-47f7-8c89-a7b8c597107b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:22.326579 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d2b990de-80da-47f7-8c89-a7b8c597107b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:22.326936 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d2b990de-80da-47f7-8c89-a7b8c597107b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:22.328086 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d2b990de-80da-47f7-8c89-a7b8c597107b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:22.328531 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d2b990de-80da-47f7-8c89-a7b8c597107b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:22.364990 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d2b990de-80da-47f7-8c89-a7b8c597107b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:22.368653 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d2b990de-80da-47f7-8c89-a7b8c597107b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:22.369193 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.objects.instance [None req-d2b990de-80da-47f7-8c89-a7b8c597107b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lazy-loading 'fault' on Instance uuid a275173c-51a6-4cc6-aef2-b30bcee8b67b {{(pid=117399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:22:22.420661 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-d2b990de-80da-47f7-8c89-a7b8c597107b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:22.431072 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-d2b990de-80da-47f7-8c89-a7b8c597107b tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 200 len: 1330 microversion: 2.1 time: 0.115800 May 10 03:22:22.431673 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 276/540] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:22 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 1330 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:22:23.450841 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-33e95177-3b56-4b70-adf4-6eab18617608 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:23.451699 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-33e95177-3b56-4b70-adf4-6eab18617608 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:23.463222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-33e95177-3b56-4b70-adf4-6eab18617608 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:23.463763 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-33e95177-3b56-4b70-adf4-6eab18617608 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:23.464860 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-33e95177-3b56-4b70-adf4-6eab18617608 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:23.465690 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-33e95177-3b56-4b70-adf4-6eab18617608 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:23.481320 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-33e95177-3b56-4b70-adf4-6eab18617608 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] HTTP exception thrown: Instance a275173c-51a6-4cc6-aef2-b30bcee8b67b could not be found. May 10 03:22:23.482974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-33e95177-3b56-4b70-adf4-6eab18617608 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Request method failure captured: May 10 03:22:23.482974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b HTTP/1.1 May 10 03:22:23.482974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:22:23.482974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:22:23.482974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:22:23.482974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:22:23.482974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:22:23.482974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:22:23.482974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:22:23.482974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:22:23.482974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedm7QRYCgCmNpOHEq-xocEssXcoKFt3Cw-xUSJVkpdbWkcE2a4swkD5OOWo0sIcmaGXBYMa4anhP-9-xwsnmr7TD0HDae0_ZejhV9Z7LARWPFLjL5ozyZp775dsZG_BfqUR5n4ZQlWeOoqrl2-8Sk1TTVheuLGMVx-c_z5Xm6ARd90Q May 10 03:22:23.482974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:22:23.482974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:22:23.482974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:22:23.482974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:22:23.482974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:22:23.482974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:22:23.482974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:22:23.482974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:22:23.482974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:22:23.482974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:22:23.484433 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b7c607953b94c02977d60c0b0536e24", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b7c607953b94c02977d60c0b0536e24"}]}] May 10 03:22:23.484433 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:22:23.484433 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:22:23.484433 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:22:23.484433 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:22:23.484433 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:22:23.484433 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:22:23.484433 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: 9407e88fdbd74ba196ffd9fd221e15f5 May 10 03:22:23.484433 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:22:23.484433 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:22:23.484433 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Instance a275173c-51a6-4cc6-aef2-b30bcee8b67b could not be found. May 10 03:22:23.484433 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'id': 'a275173c-51a6-4cc6-aef2-b30bcee8b67b'} May 10 03:22:23.485249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:22:23.485249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:22:23.485249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:22:23.485249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:22:23.485249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:22:23.485249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:22:23.485249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:22:23.485249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:22:23.485249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:22:23.485249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:22:23.485249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a275173c-51a6-4cc6-aef2-b30bcee8b67b could not be found. May 10 03:22:23.485249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:22:23.485249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:22:23.485249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:22:23.485249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:22:23.485249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:22:23.485249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:22:23.485249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:22:23.485249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:22:23.485249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:22:23.486403 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:22:23.486403 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:22:23.486403 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:22:23.486403 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:22:23.486403 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:22:23.486403 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:22:23.486403 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:22:23.486403 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a275173c-51a6-4cc6-aef2-b30bcee8b67b could not be found. May 10 03:22:23.486403 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:22:23.486403 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:22:23.486403 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:22:23.486403 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:22:23.486403 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:22:23.486403 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:22:23.486403 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:22:23.486403 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:22:23.486403 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a275173c-51a6-4cc6-aef2-b30bcee8b67b could not be found. May 10 03:22:23.486403 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:22:23.487417 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-33e95177-3b56-4b70-adf4-6eab18617608 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Returning 404 to user: Instance a275173c-51a6-4cc6-aef2-b30bcee8b67b could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:22:23.487417 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-33e95177-3b56-4b70-adf4-6eab18617608 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 404 len: 111 microversion: 2.1 time: 0.037523 May 10 03:22:23.487417 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 265/541] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:23 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:22:23.494303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ef16640e-85b2-41af-9f9f-d9036a98eb1e tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '.version_select at 0x7f6a5db24820>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:23.564670 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ef16640e-85b2-41af-9f9f-d9036a98eb1e tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-885825858" status: 202 len: 0 microversion: 2.1 time: 0.074711 May 10 03:22:23.565284 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 277/542] 10.222.0.65 () {58 vars in 1217 bytes} [Tue May 10 03:22:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-885825858 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:22:24.264859 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-4952732f-f075-402f-bca9-8cb05b0f20ea req-ea2edfc8-efb1-43ea-9afd-e56fa1354fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eedf1629-9431-4b77-92e3-253377280b0b", "tag": "28d80747-ff10-4f4c-93bb-2b2d343c9e8e"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:24.273396 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-4952732f-f075-402f-bca9-8cb05b0f20ea req-ea2edfc8-efb1-43ea-9afd-e56fa1354fc6 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:24.273839 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-4952732f-f075-402f-bca9-8cb05b0f20ea req-ea2edfc8-efb1-43ea-9afd-e56fa1354fc6 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:24.284935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-4952732f-f075-402f-bca9-8cb05b0f20ea req-ea2edfc8-efb1-43ea-9afd-e56fa1354fc6 service nova] Creating event network-changed:28d80747-ff10-4f4c-93bb-2b2d343c9e8e for instance eedf1629-9431-4b77-92e3-253377280b0b on hv-cinder-83009 May 10 03:22:24.290030 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-4952732f-f075-402f-bca9-8cb05b0f20ea req-ea2edfc8-efb1-43ea-9afd-e56fa1354fc6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028852 May 10 03:22:24.290874 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 266/543] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:22:24.366477 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-61364eae-f17e-4eb3-8fec-e77610eff7b3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Action: 'create', calling method: .version_select at 0x7f6a5db1fca0>, body: {"keypair": {"name": "tempest-keypair-1898385862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqj4b77YUk+lsIGsmBln/7A7IeZ2Qn6gTqG3V2ZxmPPsHesUYYKDdGHPXBAkSMb312kWDAGZKKNZZ1+5kFvV/a9Nx6c1XHqsYQLYgP7+/eA0Y7FVLeSoVC0Jc1nE5M74Q=="}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:24.387142 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-61364eae-f17e-4eb3-8fec-e77610eff7b3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Getting quotas for project 0b7c607953b94c02977d60c0b0536e24. Resources: {'key_pairs'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:22:24.391781 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-61364eae-f17e-4eb3-8fec-e77610eff7b3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Getting quotas for user 9407e88fdbd74ba196ffd9fd221e15f5 and project 0b7c607953b94c02977d60c0b0536e24. Resources: {'key_pairs'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:22:24.498411 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-61364eae-f17e-4eb3-8fec-e77610eff7b3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.136120 May 10 03:22:24.502816 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 278/544] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 10 03:22:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:22:26.689925 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-13918fd6-80a6-4b20-8e90-779b5d669314 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1006105752"}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:26.690456 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-13918fd6-80a6-4b20-8e90-779b5d669314 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:26.696484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-13918fd6-80a6-4b20-8e90-779b5d669314 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:26.696928 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-13918fd6-80a6-4b20-8e90-779b5d669314 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:26.697684 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-13918fd6-80a6-4b20-8e90-779b5d669314 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:26.698114 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-13918fd6-80a6-4b20-8e90-779b5d669314 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:26.806507 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-d21056c2-45c5-4fe3-a118-cf4f1436e1d6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1521154248", "imageRef": "7ce6e103-a571-4b59-9162-ff1107650c97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1e0211ea-07f5-489a-bffd-a2279bfba53a"}], "security_groups": [{"name": "tempest-securitygroup--581870068"}], "key_name": "tempest-keypair-1898385862", "user_data": "}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:26.823638 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.network.security_group_api [None req-13918fd6-80a6-4b20-8e90-779b5d669314 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Adding security group 76e6e958-f119-42af-b5d9-3ca1306a1bc1 to port 28d80747-ff10-4f4c-93bb-2b2d343c9e8e May 10 03:22:26.944329 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.network.neutron [None req-d21056c2-45c5-4fe3-a118-cf4f1436e1d6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] validate_networks() for [('1e0211ea-07f5-489a-bffd-a2279bfba53a', None, None, None, None, None)] {{(pid=117399) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:22:27.502175 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-13918fd6-80a6-4b20-8e90-779b5d669314 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "POST /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b/action" status: 202 len: 0 microversion: 2.1 time: 0.816964 May 10 03:22:27.506129 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 267/545] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 03:22:26 2022] POST /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b/action => generated 0 bytes in 819 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:22:27.511761 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-51e81429-5a67-41a1-a3c1-3a1beb9ed1c7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:27.512359 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-51e81429-5a67-41a1-a3c1-3a1beb9ed1c7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:27.518211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-51e81429-5a67-41a1-a3c1-3a1beb9ed1c7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:27.518598 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-51e81429-5a67-41a1-a3c1-3a1beb9ed1c7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:27.519361 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-51e81429-5a67-41a1-a3c1-3a1beb9ed1c7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:27.519795 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-51e81429-5a67-41a1-a3c1-3a1beb9ed1c7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:27.569862 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-d21056c2-45c5-4fe3-a118-cf4f1436e1d6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Flavor limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:22:27.570282 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-d21056c2-45c5-4fe3-a118-cf4f1436e1d6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Image limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:22:27.570747 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-d21056c2-45c5-4fe3-a118-cf4f1436e1d6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Flavor pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:22:27.571146 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-d21056c2-45c5-4fe3-a118-cf4f1436e1d6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Image pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:22:27.571549 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-d21056c2-45c5-4fe3-a118-cf4f1436e1d6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:22:27.596651 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d21056c2-45c5-4fe3-a118-cf4f1436e1d6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:27.597349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d21056c2-45c5-4fe3-a118-cf4f1436e1d6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:27.598363 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d21056c2-45c5-4fe3-a118-cf4f1436e1d6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:27.599099 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d21056c2-45c5-4fe3-a118-cf4f1436e1d6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:27.622263 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-d21056c2-45c5-4fe3-a118-cf4f1436e1d6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Getting quotas for project 0b7c607953b94c02977d60c0b0536e24. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:22:27.627903 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-d21056c2-45c5-4fe3-a118-cf4f1436e1d6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Getting quotas for user 9407e88fdbd74ba196ffd9fd221e15f5 and project 0b7c607953b94c02977d60c0b0536e24. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:22:27.645076 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-d21056c2-45c5-4fe3-a118-cf4f1436e1d6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Going to run 1 instances... {{(pid=117399) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:22:27.648428 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-d21056c2-45c5-4fe3-a118-cf4f1436e1d6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ce6e103-a571-4b59-9162-ff1107650c97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:22:27.702906 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-51e81429-5a67-41a1-a3c1-3a1beb9ed1c7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:27.713086 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-51e81429-5a67-41a1-a3c1-3a1beb9ed1c7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1760 microversion: 2.1 time: 0.205206 May 10 03:22:27.713614 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 268/546] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:27 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1760 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:27.727121 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-f3c20d01-e426-40d7-869f-d275eaeb4904 req-dfcc554a-6b0e-42bb-a347-4f368182b05f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eedf1629-9431-4b77-92e3-253377280b0b", "tag": "28d80747-ff10-4f4c-93bb-2b2d343c9e8e"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:27.736073 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-f3c20d01-e426-40d7-869f-d275eaeb4904 req-dfcc554a-6b0e-42bb-a347-4f368182b05f service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:27.740162 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-f3c20d01-e426-40d7-869f-d275eaeb4904 req-dfcc554a-6b0e-42bb-a347-4f368182b05f service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:27.747753 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-f3c20d01-e426-40d7-869f-d275eaeb4904 req-dfcc554a-6b0e-42bb-a347-4f368182b05f service nova] Creating event network-changed:28d80747-ff10-4f4c-93bb-2b2d343c9e8e for instance eedf1629-9431-4b77-92e3-253377280b0b on hv-cinder-83009 May 10 03:22:27.752658 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-f3c20d01-e426-40d7-869f-d275eaeb4904 req-dfcc554a-6b0e-42bb-a347-4f368182b05f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031080 May 10 03:22:27.753439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 269/547] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:22:27.777001 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-d21056c2-45c5-4fe3-a118-cf4f1436e1d6 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.975279 May 10 03:22:27.777577 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 279/548] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 03:22:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:22:27.790804 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-5a5a70bd-2ccd-4489-b5a0-08b5f0757455 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:27.791519 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-5a5a70bd-2ccd-4489-b5a0-08b5f0757455 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:27.869565 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5a5a70bd-2ccd-4489-b5a0-08b5f0757455 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:27.877764 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-5a5a70bd-2ccd-4489-b5a0-08b5f0757455 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0" status: 200 len: 1242 microversion: 2.1 time: 0.093423 May 10 03:22:27.878875 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 270/549] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:27 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:28.894903 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a177aeaf-e08b-4030-8d86-4bc44bcc0898 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:28.895525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-a177aeaf-e08b-4030-8d86-4bc44bcc0898 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:28.902382 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a177aeaf-e08b-4030-8d86-4bc44bcc0898 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:28.902835 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a177aeaf-e08b-4030-8d86-4bc44bcc0898 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:28.903662 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a177aeaf-e08b-4030-8d86-4bc44bcc0898 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:28.904133 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a177aeaf-e08b-4030-8d86-4bc44bcc0898 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:28.964609 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-a177aeaf-e08b-4030-8d86-4bc44bcc0898 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:28.972095 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-a177aeaf-e08b-4030-8d86-4bc44bcc0898 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0" status: 200 len: 1238 microversion: 2.1 time: 0.081485 May 10 03:22:28.972663 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 280/550] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:28 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:29.989202 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-26b56462-50f4-4839-9a73-ca8083d9b382 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:29.989778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-26b56462-50f4-4839-9a73-ca8083d9b382 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:29.997636 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-26b56462-50f4-4839-9a73-ca8083d9b382 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:29.998082 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-26b56462-50f4-4839-9a73-ca8083d9b382 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:29.998845 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-26b56462-50f4-4839-9a73-ca8083d9b382 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:29.999280 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-26b56462-50f4-4839-9a73-ca8083d9b382 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:30.060588 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-26b56462-50f4-4839-9a73-ca8083d9b382 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:30.067911 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-26b56462-50f4-4839-9a73-ca8083d9b382 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0" status: 200 len: 1300 microversion: 2.1 time: 0.082604 May 10 03:22:30.068524 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 271/551] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:29 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 => generated 1300 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:31.085755 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-9387b910-e18f-4fca-9af9-f4957dae8cbb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:31.086344 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-9387b910-e18f-4fca-9af9-f4957dae8cbb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:31.093707 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9387b910-e18f-4fca-9af9-f4957dae8cbb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:31.094266 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9387b910-e18f-4fca-9af9-f4957dae8cbb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:31.095481 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9387b910-e18f-4fca-9af9-f4957dae8cbb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:31.095917 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9387b910-e18f-4fca-9af9-f4957dae8cbb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:31.233959 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-9387b910-e18f-4fca-9af9-f4957dae8cbb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:31.242073 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-9387b910-e18f-4fca-9af9-f4957dae8cbb tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0" status: 200 len: 1367 microversion: 2.1 time: 0.160119 May 10 03:22:31.242661 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 281/552] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:31 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:31.331401 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-c9f93f2d-7bf2-45e6-a86c-898dbe63509e req-c52facb1-6e2f-435d-bdef-27121f25b950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c1ceb67-3663-4d21-bf91-ab648bc249e0", "tag": "f493a15e-bd36-4dd2-b7df-1cd2f38b4180"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:31.345044 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-c9f93f2d-7bf2-45e6-a86c-898dbe63509e req-c52facb1-6e2f-435d-bdef-27121f25b950 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:31.345612 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-c9f93f2d-7bf2-45e6-a86c-898dbe63509e req-c52facb1-6e2f-435d-bdef-27121f25b950 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:31.360383 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-c9f93f2d-7bf2-45e6-a86c-898dbe63509e req-c52facb1-6e2f-435d-bdef-27121f25b950 service nova] Creating event network-changed:f493a15e-bd36-4dd2-b7df-1cd2f38b4180 for instance 3c1ceb67-3663-4d21-bf91-ab648bc249e0 on hv-cinder-83009 May 10 03:22:31.365414 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-c9f93f2d-7bf2-45e6-a86c-898dbe63509e req-c52facb1-6e2f-435d-bdef-27121f25b950 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037800 May 10 03:22:31.366062 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 272/553] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:22:32.259075 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-afce2ea4-bcbd-4d2b-a34c-5b501b51f424 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:32.259615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-afce2ea4-bcbd-4d2b-a34c-5b501b51f424 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:32.266110 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-afce2ea4-bcbd-4d2b-a34c-5b501b51f424 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:32.266559 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-afce2ea4-bcbd-4d2b-a34c-5b501b51f424 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:32.267325 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-afce2ea4-bcbd-4d2b-a34c-5b501b51f424 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:32.267763 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-afce2ea4-bcbd-4d2b-a34c-5b501b51f424 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:32.395433 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-afce2ea4-bcbd-4d2b-a34c-5b501b51f424 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:32.402627 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-afce2ea4-bcbd-4d2b-a34c-5b501b51f424 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0" status: 200 len: 1367 microversion: 2.1 time: 0.148079 May 10 03:22:32.403187 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 282/554] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:32 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:22:33.420989 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-34f3ff85-d9fb-4224-86a2-3f8378053dbc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:33.421681 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-34f3ff85-d9fb-4224-86a2-3f8378053dbc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:33.427795 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-34f3ff85-d9fb-4224-86a2-3f8378053dbc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:33.428280 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-34f3ff85-d9fb-4224-86a2-3f8378053dbc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:33.429062 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-34f3ff85-d9fb-4224-86a2-3f8378053dbc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:33.429530 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-34f3ff85-d9fb-4224-86a2-3f8378053dbc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:33.554445 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-34f3ff85-d9fb-4224-86a2-3f8378053dbc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:33.561630 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-34f3ff85-d9fb-4224-86a2-3f8378053dbc tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0" status: 200 len: 1367 microversion: 2.1 time: 0.145675 May 10 03:22:33.562201 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 273/555] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:33 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:34.578948 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-8e15d483-0d6d-4a79-bb81-63ea6ac6ee9f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:34.579611 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8e15d483-0d6d-4a79-bb81-63ea6ac6ee9f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:34.586353 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8e15d483-0d6d-4a79-bb81-63ea6ac6ee9f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:34.586805 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8e15d483-0d6d-4a79-bb81-63ea6ac6ee9f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:34.590636 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8e15d483-0d6d-4a79-bb81-63ea6ac6ee9f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:34.590636 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8e15d483-0d6d-4a79-bb81-63ea6ac6ee9f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:34.716369 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8e15d483-0d6d-4a79-bb81-63ea6ac6ee9f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:34.723613 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-8e15d483-0d6d-4a79-bb81-63ea6ac6ee9f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0" status: 200 len: 1367 microversion: 2.1 time: 0.148540 May 10 03:22:34.724231 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 283/556] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:34 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:35.741310 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-903537b5-b4c0-4792-8e22-167fe844dca0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:35.741858 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-903537b5-b4c0-4792-8e22-167fe844dca0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:35.748390 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-903537b5-b4c0-4792-8e22-167fe844dca0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:35.748852 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-903537b5-b4c0-4792-8e22-167fe844dca0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:35.749614 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-903537b5-b4c0-4792-8e22-167fe844dca0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:35.750052 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-903537b5-b4c0-4792-8e22-167fe844dca0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:35.875251 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-903537b5-b4c0-4792-8e22-167fe844dca0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:35.883222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-903537b5-b4c0-4792-8e22-167fe844dca0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0" status: 200 len: 1367 microversion: 2.1 time: 0.145848 May 10 03:22:35.883796 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 274/557] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:35 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:36.900609 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-abfad021-d5fd-43fb-983d-7b665c2387d0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:36.901220 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-abfad021-d5fd-43fb-983d-7b665c2387d0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:36.907569 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-abfad021-d5fd-43fb-983d-7b665c2387d0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:36.908033 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-abfad021-d5fd-43fb-983d-7b665c2387d0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:36.908818 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-abfad021-d5fd-43fb-983d-7b665c2387d0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:36.909257 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-abfad021-d5fd-43fb-983d-7b665c2387d0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:37.031922 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-abfad021-d5fd-43fb-983d-7b665c2387d0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:37.039256 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-abfad021-d5fd-43fb-983d-7b665c2387d0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0" status: 200 len: 1367 microversion: 2.1 time: 0.143148 May 10 03:22:37.039821 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 284/558] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:36 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 => generated 1367 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:38.056277 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-2d274c06-fc6f-4cb3-9d59-6ec96c8a6a18 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:38.056914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-2d274c06-fc6f-4cb3-9d59-6ec96c8a6a18 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:38.063125 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2d274c06-fc6f-4cb3-9d59-6ec96c8a6a18 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:38.063570 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2d274c06-fc6f-4cb3-9d59-6ec96c8a6a18 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:38.064356 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2d274c06-fc6f-4cb3-9d59-6ec96c8a6a18 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:38.064786 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2d274c06-fc6f-4cb3-9d59-6ec96c8a6a18 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:38.095104 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-9c64ea7f-0834-48e0-8cff-a5cbcaa47e2d req-0a1798ec-0100-4054-9d20-db7eb2b1aca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c1ceb67-3663-4d21-bf91-ab648bc249e0", "name": "network-vif-plugged", "status": "completed", "tag": "f493a15e-bd36-4dd2-b7df-1cd2f38b4180"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:38.104493 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-9c64ea7f-0834-48e0-8cff-a5cbcaa47e2d req-0a1798ec-0100-4054-9d20-db7eb2b1aca2 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:38.105012 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-9c64ea7f-0834-48e0-8cff-a5cbcaa47e2d req-0a1798ec-0100-4054-9d20-db7eb2b1aca2 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:38.118306 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-9c64ea7f-0834-48e0-8cff-a5cbcaa47e2d req-0a1798ec-0100-4054-9d20-db7eb2b1aca2 service nova] Creating event network-vif-plugged:f493a15e-bd36-4dd2-b7df-1cd2f38b4180 for instance 3c1ceb67-3663-4d21-bf91-ab648bc249e0 on hv-cinder-83009 May 10 03:22:38.126659 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-9c64ea7f-0834-48e0-8cff-a5cbcaa47e2d req-0a1798ec-0100-4054-9d20-db7eb2b1aca2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032210 May 10 03:22:38.126659 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 285/559] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:22:38.196420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-2d274c06-fc6f-4cb3-9d59-6ec96c8a6a18 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:38.203968 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-2d274c06-fc6f-4cb3-9d59-6ec96c8a6a18 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0" status: 200 len: 1367 microversion: 2.1 time: 0.151596 May 10 03:22:38.204577 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 275/560] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:38 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:39.222735 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-8b71a6bc-c0f0-48fa-9d73-8e94ced20f2d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:39.223476 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8b71a6bc-c0f0-48fa-9d73-8e94ced20f2d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:39.234423 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8b71a6bc-c0f0-48fa-9d73-8e94ced20f2d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:39.234880 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8b71a6bc-c0f0-48fa-9d73-8e94ced20f2d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:39.235665 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8b71a6bc-c0f0-48fa-9d73-8e94ced20f2d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:39.236294 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8b71a6bc-c0f0-48fa-9d73-8e94ced20f2d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:39.361760 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8b71a6bc-c0f0-48fa-9d73-8e94ced20f2d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:39.369743 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-8b71a6bc-c0f0-48fa-9d73-8e94ced20f2d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0" status: 200 len: 1367 microversion: 2.1 time: 0.152474 May 10 03:22:39.373969 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 286/561] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:39 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:40.386723 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-da45f308-0d36-43dc-a17e-1c8453527477 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:40.387363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-da45f308-0d36-43dc-a17e-1c8453527477 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:40.393864 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-da45f308-0d36-43dc-a17e-1c8453527477 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:40.394313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-da45f308-0d36-43dc-a17e-1c8453527477 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:40.395271 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-da45f308-0d36-43dc-a17e-1c8453527477 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:40.395780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-da45f308-0d36-43dc-a17e-1c8453527477 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:40.525867 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-da45f308-0d36-43dc-a17e-1c8453527477 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:40.533353 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-da45f308-0d36-43dc-a17e-1c8453527477 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0" status: 200 len: 1367 microversion: 2.1 time: 0.150585 May 10 03:22:40.533934 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 276/562] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:40 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:41.549794 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-0dffc970-af6a-4b83-988b-2b1854eb5945 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:41.550432 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-0dffc970-af6a-4b83-988b-2b1854eb5945 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:41.556959 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0dffc970-af6a-4b83-988b-2b1854eb5945 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:41.557409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0dffc970-af6a-4b83-988b-2b1854eb5945 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:41.558172 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0dffc970-af6a-4b83-988b-2b1854eb5945 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:41.558606 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0dffc970-af6a-4b83-988b-2b1854eb5945 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:41.684318 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-0dffc970-af6a-4b83-988b-2b1854eb5945 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:22:41.691906 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-0dffc970-af6a-4b83-988b-2b1854eb5945 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0" status: 200 len: 1557 microversion: 2.1 time: 0.145857 May 10 03:22:41.692525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 287/563] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:22:41 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:22:41.708194 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-497934c5-fd25-4481-99d9-1d91f5e20ecd tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:22:41.708678 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-497934c5-fd25-4481-99d9-1d91f5e20ecd tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:41.715503 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-497934c5-fd25-4481-99d9-1d91f5e20ecd tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:41.715956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-497934c5-fd25-4481-99d9-1d91f5e20ecd tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:41.716756 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-497934c5-fd25-4481-99d9-1d91f5e20ecd tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:41.717201 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-497934c5-fd25-4481-99d9-1d91f5e20ecd tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:41.792204 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-497934c5-fd25-4481-99d9-1d91f5e20ecd tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087793 May 10 03:22:41.793064 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 277/564] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 10 03:22:41 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:22:43.006993 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-55fa5842-2251-4d9b-b24a-8054b02c543b req-b22f3a75-7293-4759-a92e-8581e4f0f6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c1ceb67-3663-4d21-bf91-ab648bc249e0", "tag": "f493a15e-bd36-4dd2-b7df-1cd2f38b4180"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:43.015020 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-55fa5842-2251-4d9b-b24a-8054b02c543b req-b22f3a75-7293-4759-a92e-8581e4f0f6a3 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:43.015471 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-55fa5842-2251-4d9b-b24a-8054b02c543b req-b22f3a75-7293-4759-a92e-8581e4f0f6a3 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:43.027254 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-55fa5842-2251-4d9b-b24a-8054b02c543b req-b22f3a75-7293-4759-a92e-8581e4f0f6a3 service nova] Creating event network-changed:f493a15e-bd36-4dd2-b7df-1cd2f38b4180 for instance 3c1ceb67-3663-4d21-bf91-ab648bc249e0 on hv-cinder-83009 May 10 03:22:43.032175 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-55fa5842-2251-4d9b-b24a-8054b02c543b req-b22f3a75-7293-4759-a92e-8581e4f0f6a3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028809 May 10 03:22:43.032767 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 288/565] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:22:44.371554 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:22:44.372104 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Tue May 10 03:22:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:22:57.899494 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-e42fa894-f8a1-40e3-b65c-a35f65d88d99 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f97ca27e-7fda-4c11-a14a-1ac14e69bac9"}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:22:57.900578 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-e42fa894-f8a1-40e3-b65c-a35f65d88d99 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:22:57.907322 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e42fa894-f8a1-40e3-b65c-a35f65d88d99 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:57.907778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e42fa894-f8a1-40e3-b65c-a35f65d88d99 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:57.908583 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e42fa894-f8a1-40e3-b65c-a35f65d88d99 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:22:57.909026 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e42fa894-f8a1-40e3-b65c-a35f65d88d99 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:22:58.591109 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-e42fa894-f8a1-40e3-b65c-a35f65d88d99 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "POST /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.695848 May 10 03:22:58.591642 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 278/566] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 03:22:57 2022] POST /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b/os-volume_attachments => generated 194 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:23:00.012517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ce575fe8-75e2-454e-9131-3502a7cc5e95 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:00.014336 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ce575fe8-75e2-454e-9131-3502a7cc5e95 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:00.022173 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ce575fe8-75e2-454e-9131-3502a7cc5e95 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:00.022616 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ce575fe8-75e2-454e-9131-3502a7cc5e95 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:00.023380 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ce575fe8-75e2-454e-9131-3502a7cc5e95 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:00.023817 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ce575fe8-75e2-454e-9131-3502a7cc5e95 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:00.214008 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ce575fe8-75e2-454e-9131-3502a7cc5e95 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "POST /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b/action" status: 202 len: 0 microversion: 2.1 time: 0.205555 May 10 03:23:00.215172 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 289/567] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 03:23:00 2022] POST /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:23:00.223897 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-fa606500-16d4-468b-b4d3-d409b734b1b6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:00.224630 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-fa606500-16d4-468b-b4d3-d409b734b1b6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:00.231389 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fa606500-16d4-468b-b4d3-d409b734b1b6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:00.232485 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fa606500-16d4-468b-b4d3-d409b734b1b6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:00.232633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fa606500-16d4-468b-b4d3-d409b734b1b6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:00.233074 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fa606500-16d4-468b-b4d3-d409b734b1b6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:00.383175 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-fa606500-16d4-468b-b4d3-d409b734b1b6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:00.393051 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-fa606500-16d4-468b-b4d3-d409b734b1b6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1752 microversion: 2.1 time: 0.173681 May 10 03:23:00.393817 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 279/568] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:00 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:00.888351 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a250f0e6-aa21-4825-bbdd-16147936a770 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:00.888933 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-a250f0e6-aa21-4825-bbdd-16147936a770 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:00.894920 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a250f0e6-aa21-4825-bbdd-16147936a770 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:00.895373 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a250f0e6-aa21-4825-bbdd-16147936a770 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:00.896185 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a250f0e6-aa21-4825-bbdd-16147936a770 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:00.896618 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a250f0e6-aa21-4825-bbdd-16147936a770 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:00.928696 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-a250f0e6-aa21-4825-bbdd-16147936a770 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636/os-volume_attachments/c177a52d-047b-4f62-b076-34958ce03686" status: 200 len: 194 microversion: 2.20 time: 0.045347 May 10 03:23:00.929329 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 290/569] 10.222.0.65 () {60 vars in 1453 bytes} [Tue May 10 03:23:00 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636/os-volume_attachments/c177a52d-047b-4f62-b076-34958ce03686 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 03:23:00.992426 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a6245716-0e44-4bda-ae85-7e72eb9503fa tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:00.993045 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-a6245716-0e44-4bda-ae85-7e72eb9503fa tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:01.000235 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a6245716-0e44-4bda-ae85-7e72eb9503fa tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:01.000684 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a6245716-0e44-4bda-ae85-7e72eb9503fa tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:01.001447 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a6245716-0e44-4bda-ae85-7e72eb9503fa tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:01.001886 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a6245716-0e44-4bda-ae85-7e72eb9503fa tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:01.131606 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.objects.instance [None req-a6245716-0e44-4bda-ae85-7e72eb9503fa tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lazy-loading 'services' on Instance uuid e8796004-8adb-4534-a094-c62dfd2a9636 {{(pid=117400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:23:01.402787 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-a6245716-0e44-4bda-ae85-7e72eb9503fa tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636/os-volume_attachments/c177a52d-047b-4f62-b076-34958ce03686" status: 202 len: 0 microversion: 2.20 time: 0.414261 May 10 03:23:01.403414 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 280/570] 10.222.0.65 () {60 vars in 1456 bytes} [Tue May 10 03:23:00 2022] DELETE /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636/os-volume_attachments/c177a52d-047b-4f62-b076-34958ce03686 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 03:23:01.410611 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c37b2a71-3ba7-4605-9e84-a7c73bdd7cf9 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:01.411234 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-c37b2a71-3ba7-4605-9e84-a7c73bdd7cf9 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:01.415444 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-31032732-e8f2-4e36-b1db-dba8385cd51a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:01.416566 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-31032732-e8f2-4e36-b1db-dba8385cd51a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:01.418756 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c37b2a71-3ba7-4605-9e84-a7c73bdd7cf9 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:01.419216 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c37b2a71-3ba7-4605-9e84-a7c73bdd7cf9 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:01.419996 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c37b2a71-3ba7-4605-9e84-a7c73bdd7cf9 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:01.420472 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c37b2a71-3ba7-4605-9e84-a7c73bdd7cf9 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:01.423912 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-31032732-e8f2-4e36-b1db-dba8385cd51a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:01.424484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-31032732-e8f2-4e36-b1db-dba8385cd51a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:01.425271 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-31032732-e8f2-4e36-b1db-dba8385cd51a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:01.425710 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-31032732-e8f2-4e36-b1db-dba8385cd51a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:01.464238 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-31032732-e8f2-4e36-b1db-dba8385cd51a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052791 May 10 03:23:01.465337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 281/571] 10.222.0.65 () {60 vars in 1342 bytes} [Tue May 10 03:23:01 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 03:23:01.574016 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-c37b2a71-3ba7-4605-9e84-a7c73bdd7cf9 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:01.582124 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-c37b2a71-3ba7-4605-9e84-a7c73bdd7cf9 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1752 microversion: 2.1 time: 0.175378 May 10 03:23:01.582756 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 291/572] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:01 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:01.852984 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-0a5bc1fa-b928-4ba8-9035-ddf4ff56a895 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:01.853913 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-0a5bc1fa-b928-4ba8-9035-ddf4ff56a895 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:01.860438 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0a5bc1fa-b928-4ba8-9035-ddf4ff56a895 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:01.860886 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0a5bc1fa-b928-4ba8-9035-ddf4ff56a895 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:01.861645 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0a5bc1fa-b928-4ba8-9035-ddf4ff56a895 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:01.862079 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0a5bc1fa-b928-4ba8-9035-ddf4ff56a895 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:01.883880 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.objects.instance [None req-0a5bc1fa-b928-4ba8-9035-ddf4ff56a895 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lazy-loading 'flavor' on Instance uuid a010d765-8dc4-44a9-922a-feabd172565b {{(pid=117400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:23:02.260497 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-0a5bc1fa-b928-4ba8-9035-ddf4ff56a895 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "POST /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b/action" status: 200 len: 32 microversion: 2.1 time: 0.411279 May 10 03:23:02.261757 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 282/573] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 03:23:01 2022] POST /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b/action => generated 32 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:23:02.271264 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-8f36d7ec-f32f-44c8-a31b-c1888b697912 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:02.271748 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8f36d7ec-f32f-44c8-a31b-c1888b697912 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:02.278723 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8f36d7ec-f32f-44c8-a31b-c1888b697912 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:02.279177 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8f36d7ec-f32f-44c8-a31b-c1888b697912 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:02.279958 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8f36d7ec-f32f-44c8-a31b-c1888b697912 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:02.280440 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8f36d7ec-f32f-44c8-a31b-c1888b697912 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:02.418281 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8f36d7ec-f32f-44c8-a31b-c1888b697912 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:02.426255 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-8f36d7ec-f32f-44c8-a31b-c1888b697912 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1736 microversion: 2.1 time: 0.159318 May 10 03:23:02.426824 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 292/574] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:02 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:02.477049 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-aec16e72-99ac-42e2-a3e9-2a22d229959a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:02.478198 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-aec16e72-99ac-42e2-a3e9-2a22d229959a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:02.484305 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-aec16e72-99ac-42e2-a3e9-2a22d229959a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:02.484746 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-aec16e72-99ac-42e2-a3e9-2a22d229959a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:02.485716 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-aec16e72-99ac-42e2-a3e9-2a22d229959a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:02.486211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-aec16e72-99ac-42e2-a3e9-2a22d229959a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:02.517327 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-aec16e72-99ac-42e2-a3e9-2a22d229959a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044391 May 10 03:23:02.517958 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 283/575] 10.222.0.65 () {60 vars in 1342 bytes} [Tue May 10 03:23:02 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:02.579409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-1e684e73-0451-40b2-a673-d8fc501d729f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:02.580243 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-1e684e73-0451-40b2-a673-d8fc501d729f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:02.586136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1e684e73-0451-40b2-a673-d8fc501d729f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:02.586588 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1e684e73-0451-40b2-a673-d8fc501d729f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:02.587357 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1e684e73-0451-40b2-a673-d8fc501d729f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:02.587791 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1e684e73-0451-40b2-a673-d8fc501d729f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:02.599647 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a70c5b56-7de7-48cb-9b1d-b07566a05341 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:02.600290 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-a70c5b56-7de7-48cb-9b1d-b07566a05341 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:02.606728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a70c5b56-7de7-48cb-9b1d-b07566a05341 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:02.607735 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a70c5b56-7de7-48cb-9b1d-b07566a05341 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:02.607962 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a70c5b56-7de7-48cb-9b1d-b07566a05341 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:02.608429 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a70c5b56-7de7-48cb-9b1d-b07566a05341 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:02.618809 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-1e684e73-0451-40b2-a673-d8fc501d729f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Going to try to terminate instance {{(pid=117399) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:23:02.767240 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-a70c5b56-7de7-48cb-9b1d-b07566a05341 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:02.775634 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-a70c5b56-7de7-48cb-9b1d-b07566a05341 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1757 microversion: 2.1 time: 0.179749 May 10 03:23:02.776244 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 284/576] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:02 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:02.953901 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-1e684e73-0451-40b2-a673-d8fc501d729f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 204 len: 0 microversion: 2.20 time: 0.377831 May 10 03:23:02.954124 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 293/577] 10.222.0.65 () {60 vars in 1279 bytes} [Tue May 10 03:23:02 2022] DELETE /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 03:23:02.962141 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-7fae7288-3a66-4818-a412-9468447b52ff tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:02.962714 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-7fae7288-3a66-4818-a412-9468447b52ff tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:02.969184 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7fae7288-3a66-4818-a412-9468447b52ff tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:02.969622 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7fae7288-3a66-4818-a412-9468447b52ff tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:02.970378 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7fae7288-3a66-4818-a412-9468447b52ff tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:02.970807 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7fae7288-3a66-4818-a412-9468447b52ff tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:03.098353 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-7fae7288-3a66-4818-a412-9468447b52ff tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:03.105936 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-7fae7288-3a66-4818-a412-9468447b52ff tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:03.107413 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-7fae7288-3a66-4818-a412-9468447b52ff tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:03.108691 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-7fae7288-3a66-4818-a412-9468447b52ff tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1722 microversion: 2.20 time: 0.150299 May 10 03:23:03.109562 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 285/578] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:23:02 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:23:03.444911 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-9d597410-5077-46f8-9252-60182042ca41 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:03.445614 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-9d597410-5077-46f8-9252-60182042ca41 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:03.452702 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9d597410-5077-46f8-9252-60182042ca41 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:03.453156 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9d597410-5077-46f8-9252-60182042ca41 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:03.453928 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9d597410-5077-46f8-9252-60182042ca41 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:03.454371 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9d597410-5077-46f8-9252-60182042ca41 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:03.580407 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-9d597410-5077-46f8-9252-60182042ca41 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:03.588200 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-9d597410-5077-46f8-9252-60182042ca41 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1736 microversion: 2.1 time: 0.147544 May 10 03:23:03.588777 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 294/579] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:03 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:03.794314 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-397248ab-46ff-4ff5-8f53-a10a637d7316 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:03.794850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-397248ab-46ff-4ff5-8f53-a10a637d7316 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:03.800800 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-397248ab-46ff-4ff5-8f53-a10a637d7316 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:03.801253 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-397248ab-46ff-4ff5-8f53-a10a637d7316 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:03.802017 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-397248ab-46ff-4ff5-8f53-a10a637d7316 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:03.802455 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-397248ab-46ff-4ff5-8f53-a10a637d7316 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:03.943032 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-397248ab-46ff-4ff5-8f53-a10a637d7316 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:03.950742 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-397248ab-46ff-4ff5-8f53-a10a637d7316 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1757 microversion: 2.1 time: 0.161052 May 10 03:23:03.951315 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 286/580] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:03 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:04.132936 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-11c4f2ba-c4c2-437a-9a4a-678af7921ada tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:04.133564 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-11c4f2ba-c4c2-437a-9a4a-678af7921ada tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:04.140176 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-11c4f2ba-c4c2-437a-9a4a-678af7921ada tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:04.140635 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-11c4f2ba-c4c2-437a-9a4a-678af7921ada tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:04.141400 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-11c4f2ba-c4c2-437a-9a4a-678af7921ada tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:04.141832 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-11c4f2ba-c4c2-437a-9a4a-678af7921ada tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:04.270393 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-11c4f2ba-c4c2-437a-9a4a-678af7921ada tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:04.278141 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-11c4f2ba-c4c2-437a-9a4a-678af7921ada tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:04.283391 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-11c4f2ba-c4c2-437a-9a4a-678af7921ada tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:04.283391 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-11c4f2ba-c4c2-437a-9a4a-678af7921ada tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1722 microversion: 2.20 time: 0.151716 May 10 03:23:04.283391 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 295/581] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:23:04 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:23:04.604530 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-5d4fe680-3bc8-4eef-8663-131c98a3649d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:04.605139 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-5d4fe680-3bc8-4eef-8663-131c98a3649d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:04.612270 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5d4fe680-3bc8-4eef-8663-131c98a3649d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:04.612726 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5d4fe680-3bc8-4eef-8663-131c98a3649d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:04.613508 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5d4fe680-3bc8-4eef-8663-131c98a3649d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:04.613944 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5d4fe680-3bc8-4eef-8663-131c98a3649d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:04.743104 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5d4fe680-3bc8-4eef-8663-131c98a3649d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:04.750867 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-5d4fe680-3bc8-4eef-8663-131c98a3649d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1736 microversion: 2.1 time: 0.150250 May 10 03:23:04.751426 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 287/582] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:04 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:04.972231 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a353ce1e-2c41-46f5-8534-109ddcfb6076 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:04.972956 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-a353ce1e-2c41-46f5-8534-109ddcfb6076 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:04.979326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a353ce1e-2c41-46f5-8534-109ddcfb6076 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:04.979877 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a353ce1e-2c41-46f5-8534-109ddcfb6076 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:04.980770 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a353ce1e-2c41-46f5-8534-109ddcfb6076 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:04.981282 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a353ce1e-2c41-46f5-8534-109ddcfb6076 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:05.125691 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-a353ce1e-2c41-46f5-8534-109ddcfb6076 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:05.133802 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-a353ce1e-2c41-46f5-8534-109ddcfb6076 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1757 microversion: 2.1 time: 0.169890 May 10 03:23:05.134383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 296/583] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:04 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:05.299175 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-6d442a73-192c-462c-9a16-cf32c9b3fcbf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:05.299780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-6d442a73-192c-462c-9a16-cf32c9b3fcbf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:05.305607 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6d442a73-192c-462c-9a16-cf32c9b3fcbf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:05.306051 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6d442a73-192c-462c-9a16-cf32c9b3fcbf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:05.306798 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6d442a73-192c-462c-9a16-cf32c9b3fcbf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:05.307229 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6d442a73-192c-462c-9a16-cf32c9b3fcbf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:05.374854 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-6d442a73-192c-462c-9a16-cf32c9b3fcbf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:05.383219 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-6d442a73-192c-462c-9a16-cf32c9b3fcbf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:05.384867 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-6d442a73-192c-462c-9a16-cf32c9b3fcbf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:05.389460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-6d442a73-192c-462c-9a16-cf32c9b3fcbf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1656 microversion: 2.20 time: 0.090703 May 10 03:23:05.389460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 288/584] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:23:05 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1656 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:23:05.640383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-fa67bdd0-e1be-466f-9220-74c6b9ca1a6c req-90fe8d97-5884-47b1-8b3e-c5f475ecb49a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8796004-8adb-4534-a094-c62dfd2a9636", "name": "network-vif-deleted", "tag": "373a71b7-374a-4584-ad6b-1d09a234ef37"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:05.648605 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-fa67bdd0-e1be-466f-9220-74c6b9ca1a6c req-90fe8d97-5884-47b1-8b3e-c5f475ecb49a service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:05.652606 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-fa67bdd0-e1be-466f-9220-74c6b9ca1a6c req-90fe8d97-5884-47b1-8b3e-c5f475ecb49a service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:05.660550 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-fa67bdd0-e1be-466f-9220-74c6b9ca1a6c req-90fe8d97-5884-47b1-8b3e-c5f475ecb49a service nova] Creating event network-vif-deleted:373a71b7-374a-4584-ad6b-1d09a234ef37 for instance e8796004-8adb-4534-a094-c62dfd2a9636 on hv-cinder-83009 May 10 03:23:05.665604 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-fa67bdd0-e1be-466f-9220-74c6b9ca1a6c req-90fe8d97-5884-47b1-8b3e-c5f475ecb49a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029193 May 10 03:23:05.666529 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 297/585] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:05.768545 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-c3342766-4ab1-4bab-b3a3-d90189bf5f77 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:05.769167 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-c3342766-4ab1-4bab-b3a3-d90189bf5f77 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:05.789022 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c3342766-4ab1-4bab-b3a3-d90189bf5f77 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:05.789492 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c3342766-4ab1-4bab-b3a3-d90189bf5f77 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:05.790294 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c3342766-4ab1-4bab-b3a3-d90189bf5f77 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:05.790733 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c3342766-4ab1-4bab-b3a3-d90189bf5f77 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:05.945279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-c3342766-4ab1-4bab-b3a3-d90189bf5f77 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:05.954112 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-c3342766-4ab1-4bab-b3a3-d90189bf5f77 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1736 microversion: 2.1 time: 0.189505 May 10 03:23:05.954681 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 289/586] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:05 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:06.151255 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-bde216dd-bd13-4f5d-8f4c-0ae05e2d8135 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:06.151956 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-bde216dd-bd13-4f5d-8f4c-0ae05e2d8135 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:06.158484 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bde216dd-bd13-4f5d-8f4c-0ae05e2d8135 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:06.158936 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bde216dd-bd13-4f5d-8f4c-0ae05e2d8135 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:06.159703 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bde216dd-bd13-4f5d-8f4c-0ae05e2d8135 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:06.160292 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bde216dd-bd13-4f5d-8f4c-0ae05e2d8135 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:06.307791 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-bde216dd-bd13-4f5d-8f4c-0ae05e2d8135 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:06.316226 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-bde216dd-bd13-4f5d-8f4c-0ae05e2d8135 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1757 microversion: 2.1 time: 0.169293 May 10 03:23:06.316797 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 298/587] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:06 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:06.408142 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-8cb95789-a00c-4f50-901c-9dbb31ec0632 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:06.409242 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-8cb95789-a00c-4f50-901c-9dbb31ec0632 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:06.417638 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8cb95789-a00c-4f50-901c-9dbb31ec0632 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:06.418610 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8cb95789-a00c-4f50-901c-9dbb31ec0632 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:06.419625 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8cb95789-a00c-4f50-901c-9dbb31ec0632 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:06.420102 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8cb95789-a00c-4f50-901c-9dbb31ec0632 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:06.459594 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8cb95789-a00c-4f50-901c-9dbb31ec0632 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:06.459594 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8cb95789-a00c-4f50-901c-9dbb31ec0632 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:06.459594 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.objects.instance [None req-8cb95789-a00c-4f50-901c-9dbb31ec0632 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lazy-loading 'fault' on Instance uuid e8796004-8adb-4534-a094-c62dfd2a9636 {{(pid=117400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:23:06.499095 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-8cb95789-a00c-4f50-901c-9dbb31ec0632 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:06.507813 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-8cb95789-a00c-4f50-901c-9dbb31ec0632 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:06.510156 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-8cb95789-a00c-4f50-901c-9dbb31ec0632 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:06.511347 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-8cb95789-a00c-4f50-901c-9dbb31ec0632 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 200 len: 1371 microversion: 2.20 time: 0.109525 May 10 03:23:06.511915 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 290/588] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:23:06 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 1371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:23:06.971170 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-6deb261c-c8e9-49b2-b12c-e02fed2b0758 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:06.971727 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-6deb261c-c8e9-49b2-b12c-e02fed2b0758 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:06.977661 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6deb261c-c8e9-49b2-b12c-e02fed2b0758 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:06.978106 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6deb261c-c8e9-49b2-b12c-e02fed2b0758 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:06.978865 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6deb261c-c8e9-49b2-b12c-e02fed2b0758 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:06.979298 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6deb261c-c8e9-49b2-b12c-e02fed2b0758 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:07.106158 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-6deb261c-c8e9-49b2-b12c-e02fed2b0758 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:07.113955 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-6deb261c-c8e9-49b2-b12c-e02fed2b0758 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1736 microversion: 2.1 time: 0.146709 May 10 03:23:07.114521 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 299/589] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:06 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:07.344955 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-3bab3126-13fb-43fc-a589-6cf999bd8505 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:07.344955 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-3bab3126-13fb-43fc-a589-6cf999bd8505 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:07.344955 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3bab3126-13fb-43fc-a589-6cf999bd8505 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:07.344955 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3bab3126-13fb-43fc-a589-6cf999bd8505 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:07.345487 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3bab3126-13fb-43fc-a589-6cf999bd8505 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:07.345487 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3bab3126-13fb-43fc-a589-6cf999bd8505 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:07.485498 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-3bab3126-13fb-43fc-a589-6cf999bd8505 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:07.493229 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-3bab3126-13fb-43fc-a589-6cf999bd8505 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1757 microversion: 2.1 time: 0.162537 May 10 03:23:07.493849 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 291/590] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:07 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:07.528702 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e67e38d3-8deb-422e-9a47-57ff8be049f4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:07.529300 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-e67e38d3-8deb-422e-9a47-57ff8be049f4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:07.536246 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e67e38d3-8deb-422e-9a47-57ff8be049f4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:07.542297 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e67e38d3-8deb-422e-9a47-57ff8be049f4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:07.542297 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e67e38d3-8deb-422e-9a47-57ff8be049f4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:07.542297 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e67e38d3-8deb-422e-9a47-57ff8be049f4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:07.552296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-e67e38d3-8deb-422e-9a47-57ff8be049f4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] HTTP exception thrown: Instance e8796004-8adb-4534-a094-c62dfd2a9636 could not be found. May 10 03:23:07.553915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e67e38d3-8deb-422e-9a47-57ff8be049f4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Request method failure captured: May 10 03:23:07.553915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 HTTP/1.1 May 10 03:23:07.553915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:23:07.553915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:23:07.553915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:23:07.553915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:23:07.553915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:23:07.553915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:23:07.553915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:23:07.553915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:23:07.553915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedmxtzjD0M3YkUhs9pT9XXP7ZiMvWrInD5BgLVozFjRHZV_8pF1ggpVEsx6Orjjk2d7DFKJZHnRRe0RjzXh9dnnTPyVUueQjwI8ffRwX7ft9vPjWESZT3v0KSFBMM7VYsNfAYqSBoase0wDWRXyWNJPP7QYI3qQ6IlTXt6CLSUOYHOk May 10 03:23:07.553915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:23:07.553915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:23:07.553915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:23:07.553915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:23:07.553915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Openstack-Nova-Api-Version: 2.20 May 10 03:23:07.553915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:23:07.553915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:23:07.553915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: 4af328ed59384b70b2312c150a124746 May 10 03:23:07.553915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1289566836 May 10 03:23:07.553915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:23:07.553915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:23:07.555548 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4af328ed59384b70b2312c150a124746", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4af328ed59384b70b2312c150a124746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4af328ed59384b70b2312c150a124746"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4af328ed59384b70b2312c150a124746"}]}] May 10 03:23:07.555548 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1289566836 May 10 03:23:07.555548 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: 4af328ed59384b70b2312c150a124746 May 10 03:23:07.555548 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1289566836 May 10 03:23:07.555548 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-AttachVolumeShelveTestJSON-1289566836-project May 10 03:23:07.555548 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:23:07.555548 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:23:07.555548 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: 9dff947a164641e7b32c639bebbffe36 May 10 03:23:07.555548 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1289566836-project May 10 03:23:07.555548 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: > May 10 03:23:07.555548 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Instance e8796004-8adb-4534-a094-c62dfd2a9636 could not be found. May 10 03:23:07.555548 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': 'e8796004-8adb-4534-a094-c62dfd2a9636'} May 10 03:23:07.556557 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:23:07.556557 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:23:07.556557 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:23:07.556557 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:23:07.556557 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:23:07.556557 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:23:07.556557 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:23:07.556557 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:23:07.556557 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:23:07.556557 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:23:07.556557 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8796004-8adb-4534-a094-c62dfd2a9636 could not be found. May 10 03:23:07.556557 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:23:07.556557 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:23:07.556557 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:23:07.556557 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:23:07.556557 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:23:07.556557 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:23:07.556557 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:23:07.556557 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:23:07.556557 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:23:07.557874 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:23:07.557874 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:23:07.557874 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:23:07.557874 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:23:07.557874 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:23:07.557874 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:23:07.557874 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:23:07.557874 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8796004-8adb-4534-a094-c62dfd2a9636 could not be found. May 10 03:23:07.557874 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:23:07.557874 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:23:07.557874 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:23:07.557874 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:23:07.557874 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:23:07.557874 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:23:07.557874 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:23:07.557874 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:23:07.557874 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8796004-8adb-4534-a094-c62dfd2a9636 could not be found. May 10 03:23:07.557874 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:23:07.559071 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e67e38d3-8deb-422e-9a47-57ff8be049f4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Returning 404 to user: Instance e8796004-8adb-4534-a094-c62dfd2a9636 could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:23:07.559071 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-e67e38d3-8deb-422e-9a47-57ff8be049f4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 404 len: 111 microversion: 2.20 time: 0.030372 May 10 03:23:07.559071 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 300/591] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:23:07 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 03:23:07.564733 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-30e1ae64-e6c4-48dd-805b-6c27e386dc40 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '.version_select at 0x7f6a5d12e940>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:07.646096 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-30e1ae64-e6c4-48dd-805b-6c27e386dc40 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-140344405" status: 204 len: 0 microversion: 2.20 time: 0.085119 May 10 03:23:07.646672 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 292/592] 10.222.0.65 () {60 vars in 1258 bytes} [Tue May 10 03:23:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-140344405 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 03:23:08.130470 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-45cf9b69-94e5-44f5-9907-42de9e216fc5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:08.131082 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-45cf9b69-94e5-44f5-9907-42de9e216fc5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:08.136854 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-45cf9b69-94e5-44f5-9907-42de9e216fc5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:08.137304 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-45cf9b69-94e5-44f5-9907-42de9e216fc5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:08.138605 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-45cf9b69-94e5-44f5-9907-42de9e216fc5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:08.139043 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-45cf9b69-94e5-44f5-9907-42de9e216fc5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:08.291573 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-45cf9b69-94e5-44f5-9907-42de9e216fc5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:08.299777 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-45cf9b69-94e5-44f5-9907-42de9e216fc5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1736 microversion: 2.1 time: 0.173095 May 10 03:23:08.304503 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 301/593] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:08 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:08.430048 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-0a722bfc-6f98-428e-91ba-ed6c39ef56a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Action: 'create', calling method: .version_select at 0x7f6a5d24fee0>, body: {"keypair": {"name": "tempest-keypair-1810819989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk2aSKqhXYAPTygi9HRST2w9BwrOjEUSykzxGACmcwFs+JExD9FsGtZc74LLAEnb/HcYrMrEEzFWIxlkfaU0rTnxGvBBu/bRqR0mh0WiX8chtAZeZW80aWVU77X1vhoKg=="}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:08.445433 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-0a722bfc-6f98-428e-91ba-ed6c39ef56a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Getting quotas for project 4af328ed59384b70b2312c150a124746. Resources: {'key_pairs'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:23:08.451354 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-0a722bfc-6f98-428e-91ba-ed6c39ef56a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Getting quotas for user 9dff947a164641e7b32c639bebbffe36 and project 4af328ed59384b70b2312c150a124746. Resources: {'key_pairs'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:23:08.511216 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-eb8d9d53-67ec-42d5-8b3b-e7947e8d4f19 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:08.511754 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-eb8d9d53-67ec-42d5-8b3b-e7947e8d4f19 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:08.518494 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-eb8d9d53-67ec-42d5-8b3b-e7947e8d4f19 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:08.518962 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-eb8d9d53-67ec-42d5-8b3b-e7947e8d4f19 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:08.519721 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-eb8d9d53-67ec-42d5-8b3b-e7947e8d4f19 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:08.520192 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-eb8d9d53-67ec-42d5-8b3b-e7947e8d4f19 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:08.537814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-0a722bfc-6f98-428e-91ba-ed6c39ef56a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.111725 May 10 03:23:08.538526 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 293/594] 10.222.0.65 () {62 vars in 1199 bytes} [Tue May 10 03:23:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 03:23:08.678212 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-eb8d9d53-67ec-42d5-8b3b-e7947e8d4f19 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:08.686977 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-eb8d9d53-67ec-42d5-8b3b-e7947e8d4f19 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1757 microversion: 2.1 time: 0.179642 May 10 03:23:08.687554 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 302/595] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:08 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:09.318215 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-8b39afd6-4c05-4db4-b89c-84a007a306c9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:09.318827 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-8b39afd6-4c05-4db4-b89c-84a007a306c9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:09.324972 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8b39afd6-4c05-4db4-b89c-84a007a306c9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:09.325419 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8b39afd6-4c05-4db4-b89c-84a007a306c9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:09.326193 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8b39afd6-4c05-4db4-b89c-84a007a306c9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:09.326631 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8b39afd6-4c05-4db4-b89c-84a007a306c9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:09.480190 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-8b39afd6-4c05-4db4-b89c-84a007a306c9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:09.488029 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-8b39afd6-4c05-4db4-b89c-84a007a306c9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1736 microversion: 2.1 time: 0.174104 May 10 03:23:09.494137 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 294/596] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:09 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:09.704492 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-0cba9d26-b29c-403b-8880-d8f8c396baf7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:09.705094 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-0cba9d26-b29c-403b-8880-d8f8c396baf7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:09.711387 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0cba9d26-b29c-403b-8880-d8f8c396baf7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:09.711832 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0cba9d26-b29c-403b-8880-d8f8c396baf7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:09.712618 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0cba9d26-b29c-403b-8880-d8f8c396baf7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:09.713047 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0cba9d26-b29c-403b-8880-d8f8c396baf7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:09.938178 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-0cba9d26-b29c-403b-8880-d8f8c396baf7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:09.945872 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-0cba9d26-b29c-403b-8880-d8f8c396baf7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1757 microversion: 2.1 time: 0.245792 May 10 03:23:09.946440 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 303/597] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:09 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1757 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:10.505674 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-fe820ac1-2453-42cf-94a5-b568cfc97b56 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:10.506429 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-fe820ac1-2453-42cf-94a5-b568cfc97b56 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:10.513027 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fe820ac1-2453-42cf-94a5-b568cfc97b56 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:10.513473 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fe820ac1-2453-42cf-94a5-b568cfc97b56 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:10.514294 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fe820ac1-2453-42cf-94a5-b568cfc97b56 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:10.514670 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fe820ac1-2453-42cf-94a5-b568cfc97b56 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:10.645289 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-fe820ac1-2453-42cf-94a5-b568cfc97b56 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:10.653182 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-fe820ac1-2453-42cf-94a5-b568cfc97b56 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1736 microversion: 2.1 time: 0.152662 May 10 03:23:10.653752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 295/598] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:10 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:10.694706 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-2b6f7913-76e0-49a2-a565-ca8d3afca4ef tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1093272135", "imageRef": "7ce6e103-a571-4b59-9162-ff1107650c97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2381b1f0-2571-49ba-9c52-e5ec6b453c14"}], "security_groups": [{"name": "tempest-securitygroup--551478551"}], "key_name": "tempest-keypair-1810819989", "user_data": "}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:10.797494 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.network.neutron [None req-2b6f7913-76e0-49a2-a565-ca8d3afca4ef tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] validate_networks() for [('2381b1f0-2571-49ba-9c52-e5ec6b453c14', None, None, None, None, None)] {{(pid=117399) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:23:10.962903 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-00738e88-a816-4a5f-8255-7e1eb901ca17 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:10.963525 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-00738e88-a816-4a5f-8255-7e1eb901ca17 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:10.970399 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-00738e88-a816-4a5f-8255-7e1eb901ca17 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:10.970399 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-00738e88-a816-4a5f-8255-7e1eb901ca17 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:10.970644 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-00738e88-a816-4a5f-8255-7e1eb901ca17 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:10.971004 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-00738e88-a816-4a5f-8255-7e1eb901ca17 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:11.203990 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-00738e88-a816-4a5f-8255-7e1eb901ca17 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:11.211674 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-00738e88-a816-4a5f-8255-7e1eb901ca17 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1757 microversion: 2.1 time: 0.252651 May 10 03:23:11.212303 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 296/599] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:10 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1757 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:11.243620 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-2b6f7913-76e0-49a2-a565-ca8d3afca4ef tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Flavor limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:23:11.244062 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-2b6f7913-76e0-49a2-a565-ca8d3afca4ef tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Image limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:23:11.244538 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-2b6f7913-76e0-49a2-a565-ca8d3afca4ef tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Flavor pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:23:11.244946 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-2b6f7913-76e0-49a2-a565-ca8d3afca4ef tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Image pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:23:11.245356 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-2b6f7913-76e0-49a2-a565-ca8d3afca4ef tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:23:11.255298 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2b6f7913-76e0-49a2-a565-ca8d3afca4ef tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:11.255748 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2b6f7913-76e0-49a2-a565-ca8d3afca4ef tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:11.256586 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2b6f7913-76e0-49a2-a565-ca8d3afca4ef tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:11.257026 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2b6f7913-76e0-49a2-a565-ca8d3afca4ef tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:11.273837 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-2b6f7913-76e0-49a2-a565-ca8d3afca4ef tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Getting quotas for project 4af328ed59384b70b2312c150a124746. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:23:11.277797 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-2b6f7913-76e0-49a2-a565-ca8d3afca4ef tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Getting quotas for user 9dff947a164641e7b32c639bebbffe36 and project 4af328ed59384b70b2312c150a124746. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:23:11.288994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-2b6f7913-76e0-49a2-a565-ca8d3afca4ef tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Going to run 1 instances... {{(pid=117399) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:23:11.291251 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-2b6f7913-76e0-49a2-a565-ca8d3afca4ef tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ce6e103-a571-4b59-9162-ff1107650c97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:23:11.441042 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-2b6f7913-76e0-49a2-a565-ca8d3afca4ef tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.750648 May 10 03:23:11.441695 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 304/600] 10.222.0.65 () {62 vars in 1187 bytes} [Tue May 10 03:23:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 03:23:11.452863 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-8ddb3ba5-eeb9-4101-9278-589dbd636a2f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:11.453478 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-8ddb3ba5-eeb9-4101-9278-589dbd636a2f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:11.507575 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-8ddb3ba5-eeb9-4101-9278-589dbd636a2f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:11.514474 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-8ddb3ba5-eeb9-4101-9278-589dbd636a2f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:11.515993 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-8ddb3ba5-eeb9-4101-9278-589dbd636a2f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:11.517120 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-8ddb3ba5-eeb9-4101-9278-589dbd636a2f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1282 microversion: 2.20 time: 0.068827 May 10 03:23:11.517684 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 297/601] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:23:11 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1282 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:23:11.670242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-65a91e69-100f-4de3-b471-363a49327d2d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:11.670852 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-65a91e69-100f-4de3-b471-363a49327d2d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:11.676854 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-65a91e69-100f-4de3-b471-363a49327d2d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:11.680791 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-65a91e69-100f-4de3-b471-363a49327d2d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:11.680791 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-65a91e69-100f-4de3-b471-363a49327d2d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:11.680791 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-65a91e69-100f-4de3-b471-363a49327d2d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:11.816933 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-65a91e69-100f-4de3-b471-363a49327d2d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:11.822262 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-65a91e69-100f-4de3-b471-363a49327d2d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1736 microversion: 2.1 time: 0.156183 May 10 03:23:11.822827 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 305/602] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:11 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:12.228525 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-12761b4c-4323-49ec-89f2-c932e9f5d319 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:12.229139 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-12761b4c-4323-49ec-89f2-c932e9f5d319 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:12.235922 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-12761b4c-4323-49ec-89f2-c932e9f5d319 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:12.236352 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-12761b4c-4323-49ec-89f2-c932e9f5d319 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:12.237125 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-12761b4c-4323-49ec-89f2-c932e9f5d319 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:12.237569 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-12761b4c-4323-49ec-89f2-c932e9f5d319 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:12.535656 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-14c62ea7-8725-49cf-8466-4b038b06871c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:12.536414 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-14c62ea7-8725-49cf-8466-4b038b06871c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:12.542671 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-14c62ea7-8725-49cf-8466-4b038b06871c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:12.547044 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-14c62ea7-8725-49cf-8466-4b038b06871c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:12.547044 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-14c62ea7-8725-49cf-8466-4b038b06871c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:12.547044 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-14c62ea7-8725-49cf-8466-4b038b06871c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:12.650215 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-14c62ea7-8725-49cf-8466-4b038b06871c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:12.656871 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-12761b4c-4323-49ec-89f2-c932e9f5d319 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:12.658055 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-14c62ea7-8725-49cf-8466-4b038b06871c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:12.659509 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-14c62ea7-8725-49cf-8466-4b038b06871c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:12.660635 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-14c62ea7-8725-49cf-8466-4b038b06871c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1278 microversion: 2.20 time: 0.129431 May 10 03:23:12.661180 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 306/603] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:23:12 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1278 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:23:12.665683 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-12761b4c-4323-49ec-89f2-c932e9f5d319 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1757 microversion: 2.1 time: 0.441021 May 10 03:23:12.672546 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 298/604] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:12 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1757 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:12.839971 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-8df5c150-9b26-461b-b6f1-3b737bd92c8d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:12.840542 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8df5c150-9b26-461b-b6f1-3b737bd92c8d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:12.846424 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8df5c150-9b26-461b-b6f1-3b737bd92c8d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:12.846898 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8df5c150-9b26-461b-b6f1-3b737bd92c8d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:12.847667 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8df5c150-9b26-461b-b6f1-3b737bd92c8d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:12.848136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8df5c150-9b26-461b-b6f1-3b737bd92c8d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:12.972877 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8df5c150-9b26-461b-b6f1-3b737bd92c8d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:12.980641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-8df5c150-9b26-461b-b6f1-3b737bd92c8d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1736 microversion: 2.1 time: 0.144764 May 10 03:23:12.981240 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 307/605] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:12 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:13.680305 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-dfdc617b-77e5-4306-a58c-5fb6cb5d24b6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:13.682407 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-dfdc617b-77e5-4306-a58c-5fb6cb5d24b6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:13.687899 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-17347c5f-46ce-427c-9741-1a5770e52dc6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:13.688748 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-17347c5f-46ce-427c-9741-1a5770e52dc6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:13.689929 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-dfdc617b-77e5-4306-a58c-5fb6cb5d24b6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:13.690386 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-dfdc617b-77e5-4306-a58c-5fb6cb5d24b6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:13.691165 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-dfdc617b-77e5-4306-a58c-5fb6cb5d24b6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:13.691645 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-dfdc617b-77e5-4306-a58c-5fb6cb5d24b6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:13.695410 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-17347c5f-46ce-427c-9741-1a5770e52dc6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:13.696152 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-17347c5f-46ce-427c-9741-1a5770e52dc6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:13.697004 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-17347c5f-46ce-427c-9741-1a5770e52dc6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:13.697875 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-17347c5f-46ce-427c-9741-1a5770e52dc6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:13.771669 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-dfdc617b-77e5-4306-a58c-5fb6cb5d24b6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:13.780074 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-dfdc617b-77e5-4306-a58c-5fb6cb5d24b6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:13.781645 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-dfdc617b-77e5-4306-a58c-5fb6cb5d24b6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:13.782781 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-dfdc617b-77e5-4306-a58c-5fb6cb5d24b6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1340 microversion: 2.20 time: 0.106433 May 10 03:23:13.783343 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 299/606] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:23:13 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1340 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:23:13.870933 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-17347c5f-46ce-427c-9741-1a5770e52dc6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:13.879351 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-17347c5f-46ce-427c-9741-1a5770e52dc6 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1757 microversion: 2.1 time: 0.195672 May 10 03:23:13.879938 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 308/607] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:13 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:13.999567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-eb3a57f4-b25a-4216-9f17-a7069aa7a22f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:14.000236 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-eb3a57f4-b25a-4216-9f17-a7069aa7a22f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:14.006162 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-eb3a57f4-b25a-4216-9f17-a7069aa7a22f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:14.006611 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-eb3a57f4-b25a-4216-9f17-a7069aa7a22f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:14.007377 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-eb3a57f4-b25a-4216-9f17-a7069aa7a22f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:14.008224 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-eb3a57f4-b25a-4216-9f17-a7069aa7a22f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:14.149160 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-eb3a57f4-b25a-4216-9f17-a7069aa7a22f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:14.157314 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-eb3a57f4-b25a-4216-9f17-a7069aa7a22f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1736 microversion: 2.1 time: 0.162395 May 10 03:23:14.157896 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 300/608] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:13 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:14.801005 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-b1961e6c-cbac-4e42-8456-2e7b86000c91 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:14.802824 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-b1961e6c-cbac-4e42-8456-2e7b86000c91 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:14.809254 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b1961e6c-cbac-4e42-8456-2e7b86000c91 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:14.809753 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b1961e6c-cbac-4e42-8456-2e7b86000c91 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:14.810534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b1961e6c-cbac-4e42-8456-2e7b86000c91 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:14.810997 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b1961e6c-cbac-4e42-8456-2e7b86000c91 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:14.897070 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-97bca569-5ae3-454e-ad8a-a011128fe0f5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:14.897786 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-97bca569-5ae3-454e-ad8a-a011128fe0f5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:14.904907 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-97bca569-5ae3-454e-ad8a-a011128fe0f5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:14.905439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-97bca569-5ae3-454e-ad8a-a011128fe0f5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:14.906235 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-97bca569-5ae3-454e-ad8a-a011128fe0f5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:14.906791 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-97bca569-5ae3-454e-ad8a-a011128fe0f5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:14.954999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-b1961e6c-cbac-4e42-8456-2e7b86000c91 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:14.967361 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-b1961e6c-cbac-4e42-8456-2e7b86000c91 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:14.982758 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-b1961e6c-cbac-4e42-8456-2e7b86000c91 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:14.982758 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-b1961e6c-cbac-4e42-8456-2e7b86000c91 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1407 microversion: 2.20 time: 0.173579 May 10 03:23:14.982758 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 309/609] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:23:14 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:23:14.983059 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-66a2dff6-1967-48d1-93c2-a4f50ba3b83e req-9d01b4c1-1118-4bb6-acdb-f5b4d6aa1cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d490231e-628d-467d-a571-2538c3646f1e", "tag": "e8ecbe35-34e0-4751-a0e4-9587716eaf81"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:14.992522 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-66a2dff6-1967-48d1-93c2-a4f50ba3b83e req-9d01b4c1-1118-4bb6-acdb-f5b4d6aa1cdd service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:14.992810 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-66a2dff6-1967-48d1-93c2-a4f50ba3b83e req-9d01b4c1-1118-4bb6-acdb-f5b4d6aa1cdd service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:15.010480 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-66a2dff6-1967-48d1-93c2-a4f50ba3b83e req-9d01b4c1-1118-4bb6-acdb-f5b4d6aa1cdd service nova] Creating event network-changed:e8ecbe35-34e0-4751-a0e4-9587716eaf81 for instance d490231e-628d-467d-a571-2538c3646f1e on hv-cinder-83009 May 10 03:23:15.018477 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-66a2dff6-1967-48d1-93c2-a4f50ba3b83e req-9d01b4c1-1118-4bb6-acdb-f5b4d6aa1cdd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041954 May 10 03:23:15.018477 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 310/610] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:23:15.070112 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-97bca569-5ae3-454e-ad8a-a011128fe0f5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:15.078792 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-97bca569-5ae3-454e-ad8a-a011128fe0f5 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1757 microversion: 2.1 time: 0.185734 May 10 03:23:15.084359 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 301/611] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:14 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:15.175314 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-6a756d36-01df-4d62-9a47-02e4939e8d69 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:15.176040 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-6a756d36-01df-4d62-9a47-02e4939e8d69 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:15.182201 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6a756d36-01df-4d62-9a47-02e4939e8d69 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:15.182653 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6a756d36-01df-4d62-9a47-02e4939e8d69 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:15.183417 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6a756d36-01df-4d62-9a47-02e4939e8d69 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:15.183856 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6a756d36-01df-4d62-9a47-02e4939e8d69 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:15.318726 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-6a756d36-01df-4d62-9a47-02e4939e8d69 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:15.327306 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-6a756d36-01df-4d62-9a47-02e4939e8d69 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1736 microversion: 2.1 time: 0.156110 May 10 03:23:15.327812 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 311/612] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:15 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:15.990286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-2cc4a815-f0aa-4536-8a56-d68ef7fa5667 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:15.990834 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-2cc4a815-f0aa-4536-8a56-d68ef7fa5667 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:15.997827 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2cc4a815-f0aa-4536-8a56-d68ef7fa5667 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:15.998379 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2cc4a815-f0aa-4536-8a56-d68ef7fa5667 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:15.999267 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2cc4a815-f0aa-4536-8a56-d68ef7fa5667 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:15.999807 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2cc4a815-f0aa-4536-8a56-d68ef7fa5667 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:16.095916 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ec905f17-fd6d-4595-9e6f-1eeb397b4a96 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:16.096559 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ec905f17-fd6d-4595-9e6f-1eeb397b4a96 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:16.102814 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ec905f17-fd6d-4595-9e6f-1eeb397b4a96 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:16.103331 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ec905f17-fd6d-4595-9e6f-1eeb397b4a96 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:16.104141 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ec905f17-fd6d-4595-9e6f-1eeb397b4a96 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:16.104586 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ec905f17-fd6d-4595-9e6f-1eeb397b4a96 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:16.128378 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-2cc4a815-f0aa-4536-8a56-d68ef7fa5667 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:16.136288 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-2cc4a815-f0aa-4536-8a56-d68ef7fa5667 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:16.138483 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-2cc4a815-f0aa-4536-8a56-d68ef7fa5667 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:16.139590 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-2cc4a815-f0aa-4536-8a56-d68ef7fa5667 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1407 microversion: 2.20 time: 0.153355 May 10 03:23:16.140177 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 302/613] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:23:15 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:23:16.243496 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ec905f17-fd6d-4595-9e6f-1eeb397b4a96 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:16.252159 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ec905f17-fd6d-4595-9e6f-1eeb397b4a96 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1757 microversion: 2.1 time: 0.159986 May 10 03:23:16.252723 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 312/614] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:16 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:16.344167 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-97ceab55-fbf0-4422-9839-a63992d4a1cc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:16.344780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-97ceab55-fbf0-4422-9839-a63992d4a1cc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:16.350799 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-97ceab55-fbf0-4422-9839-a63992d4a1cc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:16.351252 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-97ceab55-fbf0-4422-9839-a63992d4a1cc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:16.352105 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-97ceab55-fbf0-4422-9839-a63992d4a1cc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:16.352481 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-97ceab55-fbf0-4422-9839-a63992d4a1cc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:16.499997 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-97ceab55-fbf0-4422-9839-a63992d4a1cc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:16.509241 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-97ceab55-fbf0-4422-9839-a63992d4a1cc tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1736 microversion: 2.1 time: 0.168848 May 10 03:23:16.509816 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 303/615] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:16 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:17.157891 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-896d6f6c-6118-458a-b5c7-f8cc3828e550 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:17.158493 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-896d6f6c-6118-458a-b5c7-f8cc3828e550 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:17.164803 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-896d6f6c-6118-458a-b5c7-f8cc3828e550 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:17.165253 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-896d6f6c-6118-458a-b5c7-f8cc3828e550 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:17.166016 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-896d6f6c-6118-458a-b5c7-f8cc3828e550 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:17.166451 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-896d6f6c-6118-458a-b5c7-f8cc3828e550 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:17.234344 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-1568e50e-3b83-45e1-a621-8957234479f4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:17.235334 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-1568e50e-3b83-45e1-a621-8957234479f4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:17.242169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1568e50e-3b83-45e1-a621-8957234479f4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:17.242615 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1568e50e-3b83-45e1-a621-8957234479f4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:17.243377 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1568e50e-3b83-45e1-a621-8957234479f4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:17.243815 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1568e50e-3b83-45e1-a621-8957234479f4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:17.273764 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-1568e50e-3b83-45e1-a621-8957234479f4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043302 May 10 03:23:17.274336 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 304/616] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 03:23:17 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 03:23:17.279968 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-15c7ed3d-8d49-43de-bf23-87f2dd5a9c10 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:17.282521 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-15c7ed3d-8d49-43de-bf23-87f2dd5a9c10 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:17.290686 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-15c7ed3d-8d49-43de-bf23-87f2dd5a9c10 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:17.291137 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-15c7ed3d-8d49-43de-bf23-87f2dd5a9c10 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:17.291922 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-15c7ed3d-8d49-43de-bf23-87f2dd5a9c10 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:17.292388 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-15c7ed3d-8d49-43de-bf23-87f2dd5a9c10 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:17.302385 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-896d6f6c-6118-458a-b5c7-f8cc3828e550 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:17.311600 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-896d6f6c-6118-458a-b5c7-f8cc3828e550 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:17.313203 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-896d6f6c-6118-458a-b5c7-f8cc3828e550 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:17.316577 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-896d6f6c-6118-458a-b5c7-f8cc3828e550 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1407 microversion: 2.20 time: 0.163230 May 10 03:23:17.317326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 313/617] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:23:17 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:23:17.339166 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-cadf1d51-4d41-41e0-abc9-a6a8a494736a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:17.339911 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-cadf1d51-4d41-41e0-abc9-a6a8a494736a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:17.349139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-cadf1d51-4d41-41e0-abc9-a6a8a494736a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:17.349821 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-cadf1d51-4d41-41e0-abc9-a6a8a494736a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:17.351043 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-cadf1d51-4d41-41e0-abc9-a6a8a494736a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:17.351713 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-cadf1d51-4d41-41e0-abc9-a6a8a494736a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:17.378722 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-cadf1d51-4d41-41e0-abc9-a6a8a494736a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Going to try to terminate instance {{(pid=117399) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:23:17.445619 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-15c7ed3d-8d49-43de-bf23-87f2dd5a9c10 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:17.454229 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-15c7ed3d-8d49-43de-bf23-87f2dd5a9c10 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1757 microversion: 2.1 time: 0.178862 May 10 03:23:17.454809 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 305/618] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:17 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:17.526422 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-5ade5d8c-e3d8-43bf-aaaf-9123784b9216 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:17.527023 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-5ade5d8c-e3d8-43bf-aaaf-9123784b9216 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:17.532966 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5ade5d8c-e3d8-43bf-aaaf-9123784b9216 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:17.533418 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5ade5d8c-e3d8-43bf-aaaf-9123784b9216 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:17.534181 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5ade5d8c-e3d8-43bf-aaaf-9123784b9216 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:17.534615 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5ade5d8c-e3d8-43bf-aaaf-9123784b9216 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:17.609653 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-cadf1d51-4d41-41e0-abc9-a6a8a494736a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "DELETE /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 204 len: 0 microversion: 2.1 time: 0.276405 May 10 03:23:17.610351 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 314/619] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:23:17 2022] DELETE /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:23:17.619230 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e8ef9c49-684c-41f6-be54-b370e51190a0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:17.619977 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-e8ef9c49-684c-41f6-be54-b370e51190a0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:17.626630 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e8ef9c49-684c-41f6-be54-b370e51190a0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:17.627086 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e8ef9c49-684c-41f6-be54-b370e51190a0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:17.627861 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e8ef9c49-684c-41f6-be54-b370e51190a0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:17.628334 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e8ef9c49-684c-41f6-be54-b370e51190a0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:17.665850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5ade5d8c-e3d8-43bf-aaaf-9123784b9216 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:17.675289 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-5ade5d8c-e3d8-43bf-aaaf-9123784b9216 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1736 microversion: 2.1 time: 0.152586 May 10 03:23:17.675879 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 306/620] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:17 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:17.766532 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-e8ef9c49-684c-41f6-be54-b370e51190a0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:17.773889 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-e8ef9c49-684c-41f6-be54-b370e51190a0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1672 microversion: 2.1 time: 0.159057 May 10 03:23:17.774456 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 315/621] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:17 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:18.335387 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-ecc37e62-15fa-4a02-b2f6-489a06dd38a6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:18.336536 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-ecc37e62-15fa-4a02-b2f6-489a06dd38a6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:18.343875 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ecc37e62-15fa-4a02-b2f6-489a06dd38a6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:18.344201 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ecc37e62-15fa-4a02-b2f6-489a06dd38a6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:18.344944 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ecc37e62-15fa-4a02-b2f6-489a06dd38a6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:18.345377 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ecc37e62-15fa-4a02-b2f6-489a06dd38a6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:18.471261 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-71166314-3167-4a01-9ef0-b9aa6367114f tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:18.471920 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-71166314-3167-4a01-9ef0-b9aa6367114f tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:18.478348 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-71166314-3167-4a01-9ef0-b9aa6367114f tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:18.478811 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-71166314-3167-4a01-9ef0-b9aa6367114f tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:18.480261 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-71166314-3167-4a01-9ef0-b9aa6367114f tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:18.480705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-71166314-3167-4a01-9ef0-b9aa6367114f tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:18.494422 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ecc37e62-15fa-4a02-b2f6-489a06dd38a6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:18.501273 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ecc37e62-15fa-4a02-b2f6-489a06dd38a6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:18.502787 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ecc37e62-15fa-4a02-b2f6-489a06dd38a6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:18.503896 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-ecc37e62-15fa-4a02-b2f6-489a06dd38a6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1407 microversion: 2.20 time: 0.172620 May 10 03:23:18.504560 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 307/622] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:23:18 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:23:18.620734 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-71166314-3167-4a01-9ef0-b9aa6367114f tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:18.629896 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-71166314-3167-4a01-9ef0-b9aa6367114f tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1757 microversion: 2.1 time: 0.162795 May 10 03:23:18.630474 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 316/623] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:18 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:18.692890 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-de821fd1-07d6-4353-8fa5-bc5430f0b312 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:18.696483 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-de821fd1-07d6-4353-8fa5-bc5430f0b312 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:18.699960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-de821fd1-07d6-4353-8fa5-bc5430f0b312 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:18.700455 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-de821fd1-07d6-4353-8fa5-bc5430f0b312 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:18.701228 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-de821fd1-07d6-4353-8fa5-bc5430f0b312 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:18.701672 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-de821fd1-07d6-4353-8fa5-bc5430f0b312 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:18.792192 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-500b468f-2b93-4e0d-9900-eb6db210ebd6 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:18.792869 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-500b468f-2b93-4e0d-9900-eb6db210ebd6 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:18.803012 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-500b468f-2b93-4e0d-9900-eb6db210ebd6 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:18.803552 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-500b468f-2b93-4e0d-9900-eb6db210ebd6 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:18.804461 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-500b468f-2b93-4e0d-9900-eb6db210ebd6 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:18.804899 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-500b468f-2b93-4e0d-9900-eb6db210ebd6 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:18.835379 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-de821fd1-07d6-4353-8fa5-bc5430f0b312 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:18.843308 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-de821fd1-07d6-4353-8fa5-bc5430f0b312 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1736 microversion: 2.1 time: 0.154237 May 10 03:23:18.843899 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 308/624] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:18 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:18.931308 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-500b468f-2b93-4e0d-9900-eb6db210ebd6 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:18.939114 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-500b468f-2b93-4e0d-9900-eb6db210ebd6 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1672 microversion: 2.1 time: 0.150913 May 10 03:23:18.939690 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 317/625] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:18 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:19.521746 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-8fc399b7-1779-4e4b-920d-52189fdb555c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:19.522353 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-8fc399b7-1779-4e4b-920d-52189fdb555c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:19.529312 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8fc399b7-1779-4e4b-920d-52189fdb555c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:19.529760 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8fc399b7-1779-4e4b-920d-52189fdb555c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:19.530525 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8fc399b7-1779-4e4b-920d-52189fdb555c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:19.530959 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8fc399b7-1779-4e4b-920d-52189fdb555c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:19.646544 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-022b0dfa-0af6-49cf-9114-c05f390e2105 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:19.647732 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-022b0dfa-0af6-49cf-9114-c05f390e2105 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:19.654736 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-022b0dfa-0af6-49cf-9114-c05f390e2105 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:19.655198 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-022b0dfa-0af6-49cf-9114-c05f390e2105 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:19.655978 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-022b0dfa-0af6-49cf-9114-c05f390e2105 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:19.656453 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-022b0dfa-0af6-49cf-9114-c05f390e2105 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:19.660545 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-8fc399b7-1779-4e4b-920d-52189fdb555c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:19.668348 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-8fc399b7-1779-4e4b-920d-52189fdb555c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:19.670149 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-8fc399b7-1779-4e4b-920d-52189fdb555c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:19.671238 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-8fc399b7-1779-4e4b-920d-52189fdb555c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1407 microversion: 2.20 time: 0.153439 May 10 03:23:19.671783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 309/626] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:23:19 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:23:19.797702 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-022b0dfa-0af6-49cf-9114-c05f390e2105 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:19.805612 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-022b0dfa-0af6-49cf-9114-c05f390e2105 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1757 microversion: 2.1 time: 0.163036 May 10 03:23:19.806185 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 318/627] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:19 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:19.859355 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-9a723ab7-c9bc-48cc-b079-a6304ea28580 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:19.859963 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-9a723ab7-c9bc-48cc-b079-a6304ea28580 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:19.865829 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9a723ab7-c9bc-48cc-b079-a6304ea28580 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:19.866276 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9a723ab7-c9bc-48cc-b079-a6304ea28580 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:19.867039 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9a723ab7-c9bc-48cc-b079-a6304ea28580 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:19.867476 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9a723ab7-c9bc-48cc-b079-a6304ea28580 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:19.956209 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-68310963-a972-469e-9253-48d4152df675 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:19.956915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-68310963-a972-469e-9253-48d4152df675 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:19.963446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-68310963-a972-469e-9253-48d4152df675 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:19.963979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-68310963-a972-469e-9253-48d4152df675 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:19.964815 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-68310963-a972-469e-9253-48d4152df675 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:19.965256 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-68310963-a972-469e-9253-48d4152df675 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:19.995395 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-9a723ab7-c9bc-48cc-b079-a6304ea28580 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:20.004099 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-9a723ab7-c9bc-48cc-b079-a6304ea28580 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1736 microversion: 2.1 time: 0.148520 May 10 03:23:20.004684 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 310/628] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:19 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:20.092079 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-68310963-a972-469e-9253-48d4152df675 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:20.099464 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-68310963-a972-469e-9253-48d4152df675 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1672 microversion: 2.1 time: 0.147173 May 10 03:23:20.108798 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 319/629] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:19 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1672 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:20.266450 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-09451407-edb0-4e85-8644-260c34652d5a req-df2e3fda-5ed5-43ee-9778-7e88ebd8cfbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d490231e-628d-467d-a571-2538c3646f1e", "name": "network-vif-plugged", "status": "completed", "tag": "e8ecbe35-34e0-4751-a0e4-9587716eaf81"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:20.274534 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-09451407-edb0-4e85-8644-260c34652d5a req-df2e3fda-5ed5-43ee-9778-7e88ebd8cfbc service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:20.274978 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-09451407-edb0-4e85-8644-260c34652d5a req-df2e3fda-5ed5-43ee-9778-7e88ebd8cfbc service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:20.286496 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-09451407-edb0-4e85-8644-260c34652d5a req-df2e3fda-5ed5-43ee-9778-7e88ebd8cfbc service nova] Creating event network-vif-plugged:e8ecbe35-34e0-4751-a0e4-9587716eaf81 for instance d490231e-628d-467d-a571-2538c3646f1e on hv-cinder-83009 May 10 03:23:20.291342 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-09451407-edb0-4e85-8644-260c34652d5a req-df2e3fda-5ed5-43ee-9778-7e88ebd8cfbc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029255 May 10 03:23:20.291917 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 311/630] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:20.689545 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-bb40b740-8eaa-4d7c-9d69-354f1c0ce7ac tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:20.690151 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-bb40b740-8eaa-4d7c-9d69-354f1c0ce7ac tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:20.696437 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bb40b740-8eaa-4d7c-9d69-354f1c0ce7ac tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:20.696887 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bb40b740-8eaa-4d7c-9d69-354f1c0ce7ac tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:20.697653 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bb40b740-8eaa-4d7c-9d69-354f1c0ce7ac tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:20.698086 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bb40b740-8eaa-4d7c-9d69-354f1c0ce7ac tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:20.823838 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-bf033896-ed2c-4dca-b9c3-b47bc52a667a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:20.824647 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-bf033896-ed2c-4dca-b9c3-b47bc52a667a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:20.832688 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bf033896-ed2c-4dca-b9c3-b47bc52a667a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:20.833529 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bf033896-ed2c-4dca-b9c3-b47bc52a667a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:20.834092 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bf033896-ed2c-4dca-b9c3-b47bc52a667a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:20.834596 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bf033896-ed2c-4dca-b9c3-b47bc52a667a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:20.851575 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-bb40b740-8eaa-4d7c-9d69-354f1c0ce7ac tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:20.859493 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-bb40b740-8eaa-4d7c-9d69-354f1c0ce7ac tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:20.861012 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-bb40b740-8eaa-4d7c-9d69-354f1c0ce7ac tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:20.862129 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-bb40b740-8eaa-4d7c-9d69-354f1c0ce7ac tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1407 microversion: 2.20 time: 0.177088 May 10 03:23:20.872469 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 320/631] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:23:20 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:23:20.877856 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-f191e677-c3a2-4b5a-9b7f-2d1a2fa0a9b3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:20.878775 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-f191e677-c3a2-4b5a-9b7f-2d1a2fa0a9b3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:20.885670 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f191e677-c3a2-4b5a-9b7f-2d1a2fa0a9b3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:20.886395 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f191e677-c3a2-4b5a-9b7f-2d1a2fa0a9b3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:20.887647 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f191e677-c3a2-4b5a-9b7f-2d1a2fa0a9b3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:20.888953 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f191e677-c3a2-4b5a-9b7f-2d1a2fa0a9b3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:20.928847 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-f191e677-c3a2-4b5a-9b7f-2d1a2fa0a9b3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0/ips" status: 200 len: 149 microversion: 2.1 time: 0.055186 May 10 03:23:20.930241 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 321/632] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 10 03:23:20 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0/ips => generated 149 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:21.012648 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-bf033896-ed2c-4dca-b9c3-b47bc52a667a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:21.021792 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-09a99a96-c03b-46f8-9ffc-bc7ea30db3f9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:21.022523 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-09a99a96-c03b-46f8-9ffc-bc7ea30db3f9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:21.029832 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-09a99a96-c03b-46f8-9ffc-bc7ea30db3f9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:21.030413 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-09a99a96-c03b-46f8-9ffc-bc7ea30db3f9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:21.031306 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-09a99a96-c03b-46f8-9ffc-bc7ea30db3f9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:21.032061 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-09a99a96-c03b-46f8-9ffc-bc7ea30db3f9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:21.044507 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-bf033896-ed2c-4dca-b9c3-b47bc52a667a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1757 microversion: 2.1 time: 0.224188 May 10 03:23:21.047723 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 312/633] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:20 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1757 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:21.124349 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-1a5ed3c6-e82c-4842-b3b9-d323a0eae8f1 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:21.125066 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-1a5ed3c6-e82c-4842-b3b9-d323a0eae8f1 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:21.131320 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1a5ed3c6-e82c-4842-b3b9-d323a0eae8f1 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:21.131767 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1a5ed3c6-e82c-4842-b3b9-d323a0eae8f1 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:21.132563 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1a5ed3c6-e82c-4842-b3b9-d323a0eae8f1 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:21.140547 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1a5ed3c6-e82c-4842-b3b9-d323a0eae8f1 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:21.174599 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-09a99a96-c03b-46f8-9ffc-bc7ea30db3f9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:21.183009 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-09a99a96-c03b-46f8-9ffc-bc7ea30db3f9 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1736 microversion: 2.1 time: 0.166145 May 10 03:23:21.183596 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 322/634] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:21 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:21.279973 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1a5ed3c6-e82c-4842-b3b9-d323a0eae8f1 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:21.287400 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-1a5ed3c6-e82c-4842-b3b9-d323a0eae8f1 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1672 microversion: 2.1 time: 0.167944 May 10 03:23:21.288622 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 313/635] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:21 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:21.882413 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-d67033b5-e7b5-4b02-b9bb-ddb343f60555 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:21.883132 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-d67033b5-e7b5-4b02-b9bb-ddb343f60555 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:21.890024 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d67033b5-e7b5-4b02-b9bb-ddb343f60555 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:21.890479 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d67033b5-e7b5-4b02-b9bb-ddb343f60555 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:21.891258 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d67033b5-e7b5-4b02-b9bb-ddb343f60555 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:21.891699 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d67033b5-e7b5-4b02-b9bb-ddb343f60555 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:22.015243 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-98a84eae-4f9b-4f0a-8663-9ef4d45fb4a9 req-e9928fa0-2387-4388-ae8a-44d5eeee7dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1813031a-ba52-4826-9b73-69ae2af70c13", "name": "network-vif-deleted", "tag": "0b6928e9-9a74-46cf-b5b0-028b132f61ce"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:22.024607 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-98a84eae-4f9b-4f0a-8663-9ef4d45fb4a9 req-e9928fa0-2387-4388-ae8a-44d5eeee7dbb service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:22.025328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-98a84eae-4f9b-4f0a-8663-9ef4d45fb4a9 req-e9928fa0-2387-4388-ae8a-44d5eeee7dbb service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:22.036468 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-d67033b5-e7b5-4b02-b9bb-ddb343f60555 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:22.037103 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-98a84eae-4f9b-4f0a-8663-9ef4d45fb4a9 req-e9928fa0-2387-4388-ae8a-44d5eeee7dbb service nova] Creating event network-vif-deleted:0b6928e9-9a74-46cf-b5b0-028b132f61ce for instance 1813031a-ba52-4826-9b73-69ae2af70c13 on hv-cinder-83009 May 10 03:23:22.042117 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-98a84eae-4f9b-4f0a-8663-9ef4d45fb4a9 req-e9928fa0-2387-4388-ae8a-44d5eeee7dbb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031071 May 10 03:23:22.046186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 314/636] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:23:22.046809 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-d67033b5-e7b5-4b02-b9bb-ddb343f60555 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:22.047683 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-d67033b5-e7b5-4b02-b9bb-ddb343f60555 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:22.048948 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-d67033b5-e7b5-4b02-b9bb-ddb343f60555 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1407 microversion: 2.20 time: 0.170433 May 10 03:23:22.049720 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 323/637] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:23:21 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:23:22.065179 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-2ef03709-299b-4588-a85f-703db6d85f01 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:22.065883 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-2ef03709-299b-4588-a85f-703db6d85f01 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:22.074511 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2ef03709-299b-4588-a85f-703db6d85f01 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:22.075319 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2ef03709-299b-4588-a85f-703db6d85f01 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:22.077652 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2ef03709-299b-4588-a85f-703db6d85f01 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:22.078680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2ef03709-299b-4588-a85f-703db6d85f01 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:22.202891 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-9f87cd9b-7c76-4265-8460-e2016552333d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:22.205328 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-9f87cd9b-7c76-4265-8460-e2016552333d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:22.211818 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9f87cd9b-7c76-4265-8460-e2016552333d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:22.212587 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9f87cd9b-7c76-4265-8460-e2016552333d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:22.213780 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9f87cd9b-7c76-4265-8460-e2016552333d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:22.214442 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9f87cd9b-7c76-4265-8460-e2016552333d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:22.231530 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-2ef03709-299b-4588-a85f-703db6d85f01 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:22.240684 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-2ef03709-299b-4588-a85f-703db6d85f01 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1757 microversion: 2.1 time: 0.180582 May 10 03:23:22.242767 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 315/638] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:22 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:22.305869 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-f13da72a-59a4-452c-8af9-ba9807395e63 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:22.306809 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-f13da72a-59a4-452c-8af9-ba9807395e63 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:22.317281 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f13da72a-59a4-452c-8af9-ba9807395e63 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:22.317281 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f13da72a-59a4-452c-8af9-ba9807395e63 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:22.317281 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f13da72a-59a4-452c-8af9-ba9807395e63 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:22.317281 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f13da72a-59a4-452c-8af9-ba9807395e63 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:22.408429 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-f13da72a-59a4-452c-8af9-ba9807395e63 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:22.411484 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-9f87cd9b-7c76-4265-8460-e2016552333d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:22.429561 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-f13da72a-59a4-452c-8af9-ba9807395e63 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1322 microversion: 2.1 time: 0.127694 May 10 03:23:22.429794 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-9f87cd9b-7c76-4265-8460-e2016552333d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1736 microversion: 2.1 time: 0.230784 May 10 03:23:22.430350 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 316/639] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:22 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1322 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:22.434980 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 324/640] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:22 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1736 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:22.538285 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-abdc2efb-d2b0-404c-9b76-a9b27068af8f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d933cc3-8679-44d9-b838-4ed55271c518"}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:22.539333 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-abdc2efb-d2b0-404c-9b76-a9b27068af8f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:22.546227 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-abdc2efb-d2b0-404c-9b76-a9b27068af8f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:22.546672 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-abdc2efb-d2b0-404c-9b76-a9b27068af8f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:22.547435 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-abdc2efb-d2b0-404c-9b76-a9b27068af8f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:22.547866 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-abdc2efb-d2b0-404c-9b76-a9b27068af8f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:23.067883 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-91a8ba8d-8b0e-4d5d-983b-a9ff8e1403aa tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:23.067883 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-91a8ba8d-8b0e-4d5d-983b-a9ff8e1403aa tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:23.073708 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-91a8ba8d-8b0e-4d5d-983b-a9ff8e1403aa tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:23.074150 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-91a8ba8d-8b0e-4d5d-983b-a9ff8e1403aa tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:23.074905 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-91a8ba8d-8b0e-4d5d-983b-a9ff8e1403aa tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:23.075337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-91a8ba8d-8b0e-4d5d-983b-a9ff8e1403aa tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:23.206703 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-91a8ba8d-8b0e-4d5d-983b-a9ff8e1403aa tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:23.215181 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-91a8ba8d-8b0e-4d5d-983b-a9ff8e1403aa tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:23.218075 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-91a8ba8d-8b0e-4d5d-983b-a9ff8e1403aa tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:23.219493 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-91a8ba8d-8b0e-4d5d-983b-a9ff8e1403aa tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1407 microversion: 2.20 time: 0.156698 May 10 03:23:23.220088 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 325/641] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:23:23 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:23:23.259236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-05a81cf6-6d1b-4506-a2be-288be295091b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:23.264227 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-05a81cf6-6d1b-4506-a2be-288be295091b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:23.266423 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-05a81cf6-6d1b-4506-a2be-288be295091b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:23.266865 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-05a81cf6-6d1b-4506-a2be-288be295091b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:23.267618 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-05a81cf6-6d1b-4506-a2be-288be295091b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:23.268340 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-05a81cf6-6d1b-4506-a2be-288be295091b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:23.417049 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-05a81cf6-6d1b-4506-a2be-288be295091b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:23.427132 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-05a81cf6-6d1b-4506-a2be-288be295091b tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1757 microversion: 2.1 time: 0.171925 May 10 03:23:23.427950 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 326/642] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:23 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:23.446486 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e4bc6fb3-b7d9-4158-b683-be50616467c4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:23.447085 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-e4bc6fb3-b7d9-4158-b683-be50616467c4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:23.453912 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e4bc6fb3-b7d9-4158-b683-be50616467c4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:23.454980 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e4bc6fb3-b7d9-4158-b683-be50616467c4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:23.455276 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e4bc6fb3-b7d9-4158-b683-be50616467c4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:23.456103 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e4bc6fb3-b7d9-4158-b683-be50616467c4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:23.487953 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e4bc6fb3-b7d9-4158-b683-be50616467c4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:23.488428 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e4bc6fb3-b7d9-4158-b683-be50616467c4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:23.488868 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.objects.instance [None req-e4bc6fb3-b7d9-4158-b683-be50616467c4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lazy-loading 'fault' on Instance uuid 1813031a-ba52-4826-9b73-69ae2af70c13 {{(pid=117399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:23:23.529658 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-e4bc6fb3-b7d9-4158-b683-be50616467c4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:23.536900 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-e4bc6fb3-b7d9-4158-b683-be50616467c4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1327 microversion: 2.1 time: 0.094383 May 10 03:23:23.539803 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 327/643] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:23 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1327 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:23.541721 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-5c9eb281-659a-4f16-842d-28a25a725780 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:23.542312 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-5c9eb281-659a-4f16-842d-28a25a725780 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:23.548070 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5c9eb281-659a-4f16-842d-28a25a725780 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:23.548518 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5c9eb281-659a-4f16-842d-28a25a725780 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:23.549270 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5c9eb281-659a-4f16-842d-28a25a725780 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:23.549701 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5c9eb281-659a-4f16-842d-28a25a725780 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:23.677236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-5c9eb281-659a-4f16-842d-28a25a725780 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:23.685061 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-5c9eb281-659a-4f16-842d-28a25a725780 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1716 microversion: 2.1 time: 0.146683 May 10 03:23:23.686248 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 328/644] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:23 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1716 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:23.740446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e3b46e18-3e8e-4b8c-ab31-41e42782de34 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:23.740928 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-e3b46e18-3e8e-4b8c-ab31-41e42782de34 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:23.746819 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e3b46e18-3e8e-4b8c-ab31-41e42782de34 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:23.747268 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e3b46e18-3e8e-4b8c-ab31-41e42782de34 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:23.748694 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e3b46e18-3e8e-4b8c-ab31-41e42782de34 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:23.749131 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e3b46e18-3e8e-4b8c-ab31-41e42782de34 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:23.830668 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-e3b46e18-3e8e-4b8c-ab31-41e42782de34 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] HTTP exception thrown: Cannot 'detach_volume' instance a010d765-8dc4-44a9-922a-feabd172565b while it is in vm_state rescued May 10 03:23:23.832291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e3b46e18-3e8e-4b8c-ab31-41e42782de34 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Request method failure captured: May 10 03:23:23.832291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: DELETE /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b/os-volume_attachments/f97ca27e-7fda-4c11-a14a-1ac14e69bac9 HTTP/1.1 May 10 03:23:23.832291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:23:23.832291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:23:23.832291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:23:23.832291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:23:23.832291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:23:23.832291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:23:23.832291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:23:23.832291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:23:23.832291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedm4YBo_VeiW-S1UxjlvvKNx7u6jWbPbvvm0pYOm5amQBwu7q0C7Rd8nGSaIclBMXEqqaxCizBVj7NePFJ1eCV8CTM1okztCGz5tsrL80ntHdSO2lpXeHCYcWrqg_AqJQDp6ALaVfEt1ayCvEgCMFkenfpQm-YCKlUpXTGJxCi7gX6Y May 10 03:23:23.832291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:23:23.832291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:23:23.832291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:23:23.832291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:23:23.832291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:23:23.832291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:23:23.832291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: d8e319a149db44fb8bb71f3066c82956 May 10 03:23:23.832291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1946563297 May 10 03:23:23.832291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:23:23.832291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:23:23.833816 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d8e319a149db44fb8bb71f3066c82956", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8e319a149db44fb8bb71f3066c82956"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8e319a149db44fb8bb71f3066c82956"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d8e319a149db44fb8bb71f3066c82956"}]}] May 10 03:23:23.833816 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1946563297 May 10 03:23:23.833816 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: d8e319a149db44fb8bb71f3066c82956 May 10 03:23:23.833816 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1946563297 May 10 03:23:23.833816 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-ServerRescueNegativeTestJSON-1946563297-project May 10 03:23:23.833816 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:23:23.833816 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:23:23.833816 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: e309fb66a98b407d8b7533207e6a6dfc May 10 03:23:23.833816 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1946563297-project May 10 03:23:23.833816 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: > May 10 03:23:23.833816 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Cannot 'detach_volume' instance a010d765-8dc4-44a9-922a-feabd172565b while it is in vm_state rescued May 10 03:23:23.834615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'server_id': 'a010d765-8dc4-44a9-922a-feabd172565b', 'id': 'f97ca27e-7fda-4c11-a14a-1ac14e69bac9'} May 10 03:23:23.834615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:23:23.834615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:23:23.834615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 03:23:23.834615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 03:23:23.834615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 03:23:23.834615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 03:23:23.834615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 03:23:23.834615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 03:23:23.834615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a010d765-8dc4-44a9-922a-feabd172565b in vm_state rescued. Cannot detach_volume while the instance is in this state. May 10 03:23:23.834615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:23:23.834615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:23:23.834615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:23:23.834615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:23:23.834615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:23:23.834615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:23:23.834615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:23:23.834615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:23:23.834615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:23:23.834615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:23:23.835963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 10 03:23:23.835963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 03:23:23.835963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 03:23:23.835963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 03:23:23.835963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a010d765-8dc4-44a9-922a-feabd172565b while it is in vm_state rescued May 10 03:23:23.835963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:23:23.835963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:23:23.835963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:23:23.835963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:23:23.835963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:23:23.835963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:23:23.835963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:23:23.835963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:23:23.835963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a010d765-8dc4-44a9-922a-feabd172565b while it is in vm_state rescued May 10 03:23:23.835963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:23:23.835963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e3b46e18-3e8e-4b8c-ab31-41e42782de34 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Returning 409 to user: Cannot 'detach_volume' instance a010d765-8dc4-44a9-922a-feabd172565b while it is in vm_state rescued {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:23:23.837139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-e3b46e18-3e8e-4b8c-ab31-41e42782de34 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b/os-volume_attachments/f97ca27e-7fda-4c11-a14a-1ac14e69bac9" status: 409 len: 152 microversion: 2.1 time: 0.097650 May 10 03:23:23.837139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 329/645] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 10 03:23:23 2022] DELETE /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b/os-volume_attachments/f97ca27e-7fda-4c11-a14a-1ac14e69bac9 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 10 03:23:23.842526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-72c64c46-c99e-4c59-b8f3-7b420ec84a22 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:23.843043 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-72c64c46-c99e-4c59-b8f3-7b420ec84a22 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:23.848515 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-72c64c46-c99e-4c59-b8f3-7b420ec84a22 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:23.848963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-72c64c46-c99e-4c59-b8f3-7b420ec84a22 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:23.849712 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-72c64c46-c99e-4c59-b8f3-7b420ec84a22 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:23.850142 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-72c64c46-c99e-4c59-b8f3-7b420ec84a22 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:24.066302 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-72c64c46-c99e-4c59-b8f3-7b420ec84a22 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "POST /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b/action" status: 202 len: 0 microversion: 2.1 time: 0.227535 May 10 03:23:24.067375 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 330/646] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 03:23:23 2022] POST /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 03:23:24.078020 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-87b4906e-9364-488d-9479-953881d9fd7d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:24.079076 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-87b4906e-9364-488d-9479-953881d9fd7d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:24.085334 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-87b4906e-9364-488d-9479-953881d9fd7d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:24.085781 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-87b4906e-9364-488d-9479-953881d9fd7d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:24.086547 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-87b4906e-9364-488d-9479-953881d9fd7d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:24.086981 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-87b4906e-9364-488d-9479-953881d9fd7d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:24.215360 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-87b4906e-9364-488d-9479-953881d9fd7d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:24.223720 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-87b4906e-9364-488d-9479-953881d9fd7d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1724 microversion: 2.1 time: 0.151865 May 10 03:23:24.224316 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 331/647] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:24 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:24.237607 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ec1408bc-b17f-4b34-9d01-53d7b9eb5e7e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:24.238509 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ec1408bc-b17f-4b34-9d01-53d7b9eb5e7e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:24.244018 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ec1408bc-b17f-4b34-9d01-53d7b9eb5e7e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:24.244510 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ec1408bc-b17f-4b34-9d01-53d7b9eb5e7e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:24.245262 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ec1408bc-b17f-4b34-9d01-53d7b9eb5e7e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:24.245693 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ec1408bc-b17f-4b34-9d01-53d7b9eb5e7e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:24.385796 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ec1408bc-b17f-4b34-9d01-53d7b9eb5e7e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:24.394074 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ec1408bc-b17f-4b34-9d01-53d7b9eb5e7e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:24.395578 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ec1408bc-b17f-4b34-9d01-53d7b9eb5e7e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:24.396790 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ec1408bc-b17f-4b34-9d01-53d7b9eb5e7e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1599 microversion: 2.20 time: 0.162780 May 10 03:23:24.397350 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 332/648] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:23:24 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:23:24.414227 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-28fdc8f9-5709-48dd-b505-665175247c12 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:24.414728 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-28fdc8f9-5709-48dd-b505-665175247c12 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:24.421481 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-28fdc8f9-5709-48dd-b505-665175247c12 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:24.421916 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-28fdc8f9-5709-48dd-b505-665175247c12 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:24.422719 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-28fdc8f9-5709-48dd-b505-665175247c12 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:24.423165 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-28fdc8f9-5709-48dd-b505-665175247c12 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:24.503223 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-28fdc8f9-5709-48dd-b505-665175247c12 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092641 May 10 03:23:24.503890 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 333/649] 10.222.0.65 () {60 vars in 1315 bytes} [Tue May 10 03:23:24 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 03:23:24.508572 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e164f746-015b-4d3a-aa85-5b6e680b6527 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:24.509178 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-e164f746-015b-4d3a-aa85-5b6e680b6527 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:24.515687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e164f746-015b-4d3a-aa85-5b6e680b6527 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:24.516169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e164f746-015b-4d3a-aa85-5b6e680b6527 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:24.516934 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e164f746-015b-4d3a-aa85-5b6e680b6527 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:24.517365 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e164f746-015b-4d3a-aa85-5b6e680b6527 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:24.792271 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-abdc2efb-d2b0-404c-9b76-a9b27068af8f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "POST /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.257307 May 10 03:23:24.792924 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 317/650] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 03:23:22 2022] POST /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0/os-volume_attachments => generated 194 bytes in 2259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:24.800218 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-e164f746-015b-4d3a-aa85-5b6e680b6527 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:24.807095 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-ea1b08cc-1820-411e-89f0-5d6283bfaeba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:24.808267 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-e164f746-015b-4d3a-aa85-5b6e680b6527 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1760 microversion: 2.1 time: 0.303219 May 10 03:23:24.809043 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 334/651] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:24 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1760 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:24.811777 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-ea1b08cc-1820-411e-89f0-5d6283bfaeba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:24.827139 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ea1b08cc-1820-411e-89f0-5d6283bfaeba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:24.828266 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ea1b08cc-1820-411e-89f0-5d6283bfaeba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:24.829119 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ea1b08cc-1820-411e-89f0-5d6283bfaeba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:24.829566 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ea1b08cc-1820-411e-89f0-5d6283bfaeba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:24.864655 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ea1b08cc-1820-411e-89f0-5d6283bfaeba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:24.865162 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ea1b08cc-1820-411e-89f0-5d6283bfaeba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:24.865935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.objects.instance [None req-ea1b08cc-1820-411e-89f0-5d6283bfaeba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lazy-loading 'fault' on Instance uuid 1813031a-ba52-4826-9b73-69ae2af70c13 {{(pid=117400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:23:24.954836 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ea1b08cc-1820-411e-89f0-5d6283bfaeba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:24.969093 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-ea1b08cc-1820-411e-89f0-5d6283bfaeba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 200 len: 1327 microversion: 2.1 time: 0.174959 May 10 03:23:24.969752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 318/652] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:24 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 1327 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:25.242383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-841e1bd4-548c-4de2-9037-b7632309119f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:25.243003 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-841e1bd4-548c-4de2-9037-b7632309119f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:25.250641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-841e1bd4-548c-4de2-9037-b7632309119f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:25.251147 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-841e1bd4-548c-4de2-9037-b7632309119f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:25.251958 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-841e1bd4-548c-4de2-9037-b7632309119f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:25.252428 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-841e1bd4-548c-4de2-9037-b7632309119f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:25.483717 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-841e1bd4-548c-4de2-9037-b7632309119f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:25.491414 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-841e1bd4-548c-4de2-9037-b7632309119f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1724 microversion: 2.1 time: 0.253294 May 10 03:23:25.491990 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 335/653] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:25 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:25.799832 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-cc982987-608b-4e6d-a754-d9c9245561b0 req-416f2285-0f72-40ee-aa53-0b124b59316f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d490231e-628d-467d-a571-2538c3646f1e", "tag": "e8ecbe35-34e0-4751-a0e4-9587716eaf81"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:25.808938 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-cc982987-608b-4e6d-a754-d9c9245561b0 req-416f2285-0f72-40ee-aa53-0b124b59316f service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:25.809501 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-cc982987-608b-4e6d-a754-d9c9245561b0 req-416f2285-0f72-40ee-aa53-0b124b59316f service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:25.821357 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-cc982987-608b-4e6d-a754-d9c9245561b0 req-416f2285-0f72-40ee-aa53-0b124b59316f service nova] Creating event network-changed:e8ecbe35-34e0-4751-a0e4-9587716eaf81 for instance d490231e-628d-467d-a571-2538c3646f1e on hv-cinder-83009 May 10 03:23:25.827207 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-cc982987-608b-4e6d-a754-d9c9245561b0 req-416f2285-0f72-40ee-aa53-0b124b59316f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029980 May 10 03:23:25.827522 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 319/654] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:25.986824 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e7714344-134e-4faf-a610-f38760cd3082 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:25.987435 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-e7714344-134e-4faf-a610-f38760cd3082 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:25.993242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e7714344-134e-4faf-a610-f38760cd3082 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:25.993703 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e7714344-134e-4faf-a610-f38760cd3082 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:25.994473 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e7714344-134e-4faf-a610-f38760cd3082 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:25.994915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e7714344-134e-4faf-a610-f38760cd3082 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:26.009013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-e7714344-134e-4faf-a610-f38760cd3082 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] HTTP exception thrown: Instance 1813031a-ba52-4826-9b73-69ae2af70c13 could not be found. May 10 03:23:26.010638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e7714344-134e-4faf-a610-f38760cd3082 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Request method failure captured: May 10 03:23:26.010638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 HTTP/1.1 May 10 03:23:26.010638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:23:26.010638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:23:26.010638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:23:26.010638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:23:26.010638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:23:26.010638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:23:26.010638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:23:26.010638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:23:26.010638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedmuRgU3yiCt8NQjpf24ZkF33bAoKGS2JnI3LqgS45_z5mYbV5zW2Di09E3_Nka5bvxQvM4XwbD2ES6QrLLzRNe3S9o92uubM0HfeU3XucIN7Voo0fZZ8HPJdkE9P0aPu5HOEN__j9olz-7xp2oxfqFHIDZTUlLR0ZMIGTEUTGrCapc May 10 03:23:26.010638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:23:26.010638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:23:26.010638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:23:26.010638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:23:26.010638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:23:26.010638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:23:26.010638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: 813036cfbb6e4f1b93bbf75a982aa96f May 10 03:23:26.010638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-AttachVolumeTestJSON-1652352797 May 10 03:23:26.010638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:23:26.010638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:23:26.012155 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_813036cfbb6e4f1b93bbf75a982aa96f", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/813036cfbb6e4f1b93bbf75a982aa96f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/813036cfbb6e4f1b93bbf75a982aa96f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/813036cfbb6e4f1b93bbf75a982aa96f"}]}] May 10 03:23:26.012155 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-AttachVolumeTestJSON-1652352797 May 10 03:23:26.012155 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: 813036cfbb6e4f1b93bbf75a982aa96f May 10 03:23:26.012155 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1652352797 May 10 03:23:26.012155 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-AttachVolumeTestJSON-1652352797-project May 10 03:23:26.012155 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:23:26.012155 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:23:26.012155 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: a14e317d371c4f9f994a568798c00e90 May 10 03:23:26.012155 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-AttachVolumeTestJSON-1652352797-project May 10 03:23:26.012155 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: > May 10 03:23:26.012155 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Instance 1813031a-ba52-4826-9b73-69ae2af70c13 could not be found. May 10 03:23:26.012155 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': '1813031a-ba52-4826-9b73-69ae2af70c13'} May 10 03:23:26.016949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:23:26.016949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:23:26.016949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:23:26.016949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:23:26.016949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:23:26.016949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:23:26.016949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:23:26.016949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:23:26.016949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:23:26.016949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:23:26.016949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1813031a-ba52-4826-9b73-69ae2af70c13 could not be found. May 10 03:23:26.016949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:23:26.016949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:23:26.016949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:23:26.016949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:23:26.016949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:23:26.016949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:23:26.016949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:23:26.016949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:23:26.016949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:23:26.018349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:23:26.018349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:23:26.018349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:23:26.018349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:23:26.018349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:23:26.018349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:23:26.018349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:23:26.018349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1813031a-ba52-4826-9b73-69ae2af70c13 could not be found. May 10 03:23:26.018349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:23:26.018349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:23:26.018349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:23:26.018349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:23:26.018349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:23:26.018349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:23:26.018349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:23:26.018349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:23:26.018349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1813031a-ba52-4826-9b73-69ae2af70c13 could not be found. May 10 03:23:26.018349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:23:26.020479 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e7714344-134e-4faf-a610-f38760cd3082 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Returning 404 to user: Instance 1813031a-ba52-4826-9b73-69ae2af70c13 could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:23:26.020479 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-e7714344-134e-4faf-a610-f38760cd3082 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 404 len: 111 microversion: 2.1 time: 0.029231 May 10 03:23:26.020479 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 336/655] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:25 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:23:26.023542 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-8686deef-45ca-4a5a-9ef9-2f2e19b07c85 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '.version_select at 0x7f6a5d1479d0>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:26.097998 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-8686deef-45ca-4a5a-9ef9-2f2e19b07c85 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-323377545" status: 202 len: 0 microversion: 2.1 time: 0.079521 May 10 03:23:26.098600 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 320/656] 10.222.0.65 () {58 vars in 1217 bytes} [Tue May 10 03:23:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-323377545 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:23:26.508684 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-f68282d2-ec1e-430d-921e-6b61d2cbb51b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:26.509424 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-f68282d2-ec1e-430d-921e-6b61d2cbb51b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:26.516567 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f68282d2-ec1e-430d-921e-6b61d2cbb51b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:26.517022 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f68282d2-ec1e-430d-921e-6b61d2cbb51b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:26.517833 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f68282d2-ec1e-430d-921e-6b61d2cbb51b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:26.518272 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f68282d2-ec1e-430d-921e-6b61d2cbb51b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:26.663747 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-f68282d2-ec1e-430d-921e-6b61d2cbb51b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:26.676533 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-f68282d2-ec1e-430d-921e-6b61d2cbb51b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1724 microversion: 2.1 time: 0.171820 May 10 03:23:26.677119 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 337/657] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:26 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:26.867943 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-2ceb381f-5786-43d9-b78a-e0f06e3e3d9b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Action: 'create', calling method: .version_select at 0x7f6a5d161670>, body: {"keypair": {"name": "tempest-keypair-1965655660", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAThA+qAXk1/6mgeHBlRT4XSUFpPbbyM5pqFYikZHL/cvrLrIO1zVPipHgiTWU84VgtrQTVag+7L6F8SBIt0ecfjX+EQTRorbcN/Z4+UcYX4z1MLpKtq2kg4Ui8BgwMYaw=="}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:26.882145 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-2ceb381f-5786-43d9-b78a-e0f06e3e3d9b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Getting quotas for project 813036cfbb6e4f1b93bbf75a982aa96f. Resources: {'key_pairs'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:23:26.885965 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-2ceb381f-5786-43d9-b78a-e0f06e3e3d9b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Getting quotas for user a14e317d371c4f9f994a568798c00e90 and project 813036cfbb6e4f1b93bbf75a982aa96f. Resources: {'key_pairs'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:23:26.994778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-2ceb381f-5786-43d9-b78a-e0f06e3e3d9b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.131102 May 10 03:23:26.995387 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 321/658] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 10 03:23:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:27.694154 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-be34cb44-2506-4bac-96b3-fa6f1c0b146d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:27.694755 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-be34cb44-2506-4bac-96b3-fa6f1c0b146d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:27.701086 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-be34cb44-2506-4bac-96b3-fa6f1c0b146d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:27.701544 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-be34cb44-2506-4bac-96b3-fa6f1c0b146d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:27.702329 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-be34cb44-2506-4bac-96b3-fa6f1c0b146d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:27.702751 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-be34cb44-2506-4bac-96b3-fa6f1c0b146d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:27.830386 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-be34cb44-2506-4bac-96b3-fa6f1c0b146d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:27.838880 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-be34cb44-2506-4bac-96b3-fa6f1c0b146d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1724 microversion: 2.1 time: 0.148489 May 10 03:23:27.839461 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 338/659] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:27 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:28.856368 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-7ff40d32-6094-4e86-9266-fa02121ffc1c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:28.857023 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-7ff40d32-6094-4e86-9266-fa02121ffc1c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:28.864322 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7ff40d32-6094-4e86-9266-fa02121ffc1c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:28.864781 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7ff40d32-6094-4e86-9266-fa02121ffc1c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:28.865557 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7ff40d32-6094-4e86-9266-fa02121ffc1c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:28.865998 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7ff40d32-6094-4e86-9266-fa02121ffc1c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:29.039847 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-7ff40d32-6094-4e86-9266-fa02121ffc1c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:29.049579 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-7ff40d32-6094-4e86-9266-fa02121ffc1c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1730 microversion: 2.1 time: 0.197290 May 10 03:23:29.050163 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 322/660] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:28 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:29.068759 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-7cb34999-4d38-4c29-bc93-9641b40a51b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:29.069305 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-7cb34999-4d38-4c29-bc93-9641b40a51b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:29.084077 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7cb34999-4d38-4c29-bc93-9641b40a51b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:29.084077 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7cb34999-4d38-4c29-bc93-9641b40a51b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:29.084077 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7cb34999-4d38-4c29-bc93-9641b40a51b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:29.084077 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7cb34999-4d38-4c29-bc93-9641b40a51b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:29.149287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-3f45faf5-a2b6-48b2-8bf5-2dd8ae6fe268 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d933cc3-8679-44d9-b838-4ed55271c518"}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:29.150721 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-3f45faf5-a2b6-48b2-8bf5-2dd8ae6fe268 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:29.158068 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3f45faf5-a2b6-48b2-8bf5-2dd8ae6fe268 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:29.158526 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3f45faf5-a2b6-48b2-8bf5-2dd8ae6fe268 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:29.159582 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3f45faf5-a2b6-48b2-8bf5-2dd8ae6fe268 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:29.160587 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3f45faf5-a2b6-48b2-8bf5-2dd8ae6fe268 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:29.161860 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-7cb34999-4d38-4c29-bc93-9641b40a51b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098513 May 10 03:23:29.162800 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 339/661] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 10 03:23:29 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:29.245483 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-3f45faf5-a2b6-48b2-8bf5-2dd8ae6fe268 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] HTTP exception thrown: Invalid volume: volume 2d933cc3-8679-44d9-b838-4ed55271c518 is already attached to instances: 3c1ceb67-3663-4d21-bf91-ab648bc249e0 May 10 03:23:29.250410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-3f45faf5-a2b6-48b2-8bf5-2dd8ae6fe268 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Request method failure captured: May 10 03:23:29.250410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: POST /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0/os-volume_attachments HTTP/1.1 May 10 03:23:29.250410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:23:29.250410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:23:29.250410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:23:29.250410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 74 May 10 03:23:29.250410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:23:29.250410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:23:29.250410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:23:29.250410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:23:29.250410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedm7QRYCgCmNpOHEq-xocEssXcoKFt3Cw-xUSJVkpdbWkcE2a4swkD5OOWo0sIcmaGXBYMa4anhP-9-xwsnmr7TD0HDae0_ZejhV9Z7LARWPFLjL5ozyZp775dsZG_BfqUR5n4ZQlWeOoqrl2-8Sk1TTVheuLGMVx-c_z5Xm6ARd90Q May 10 03:23:29.250410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:23:29.250410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:23:29.250410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:23:29.250410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:23:29.250410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:23:29.250410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:23:29.250410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:23:29.250410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:23:29.250410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:23:29.250410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:23:29.251907 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b7c607953b94c02977d60c0b0536e24", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b7c607953b94c02977d60c0b0536e24"}]}] May 10 03:23:29.251907 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:23:29.251907 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:23:29.251907 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:23:29.251907 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:23:29.251907 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:23:29.251907 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:23:29.251907 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: 9407e88fdbd74ba196ffd9fd221e15f5 May 10 03:23:29.251907 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:23:29.251907 dv-cinder-830094-4-smb devstack@n-api.service[117400]: May 10 03:23:29.251907 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {"volumeAttachment": {"volumeId": "2d933cc3-8679-44d9-b838-4ed55271c518"}} May 10 03:23:29.251907 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:23:29.252814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Invalid volume: volume 2d933cc3-8679-44d9-b838-4ed55271c518 is already attached to instances: 3c1ceb67-3663-4d21-bf91-ab648bc249e0 May 10 03:23:29.252814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'server_id': '3c1ceb67-3663-4d21-bf91-ab648bc249e0', 'body': {'volumeAttachment': {'volumeId': '2d933cc3-8679-44d9-b838-4ed55271c518'}}} May 10 03:23:29.252814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:23:29.252814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:23:29.252814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 03:23:29.252814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 03:23:29.252814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 03:23:29.252814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 03:23:29.252814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 03:23:29.252814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 03:23:29.252814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 03:23:29.252814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 03:23:29.252814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 03:23:29.252814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 03:23:29.252814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2d933cc3-8679-44d9-b838-4ed55271c518 is already attached to instances: 3c1ceb67-3663-4d21-bf91-ab648bc249e0 May 10 03:23:29.252814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:23:29.252814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:23:29.252814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:23:29.252814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:23:29.254155 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:23:29.254155 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:23:29.254155 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:23:29.254155 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:23:29.254155 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:23:29.254155 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:23:29.254155 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 03:23:29.254155 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:23:29.254155 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 03:23:29.254155 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:23:29.254155 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 03:23:29.254155 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 03:23:29.254155 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 03:23:29.254155 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 03:23:29.254155 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2d933cc3-8679-44d9-b838-4ed55271c518 is already attached to instances: 3c1ceb67-3663-4d21-bf91-ab648bc249e0 May 10 03:23:29.254155 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:23:29.254155 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:23:29.254155 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:23:29.254155 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:23:29.254155 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:23:29.255526 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:23:29.255526 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:23:29.255526 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:23:29.255526 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2d933cc3-8679-44d9-b838-4ed55271c518 is already attached to instances: 3c1ceb67-3663-4d21-bf91-ab648bc249e0 May 10 03:23:29.255526 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:23:29.255526 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-3f45faf5-a2b6-48b2-8bf5-2dd8ae6fe268 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Returning 400 to user: Invalid volume: volume 2d933cc3-8679-44d9-b838-4ed55271c518 is already attached to instances: 3c1ceb67-3663-4d21-bf91-ab648bc249e0 {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:23:29.255526 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-3f45faf5-a2b6-48b2-8bf5-2dd8ae6fe268 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "POST /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103666 May 10 03:23:29.255526 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 323/662] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 03:23:29 2022] POST /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 03:23:29.260221 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-beb089be-e66e-44c8-85d6-c2caec74e536 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2042264329", "imageRef": "7ce6e103-a571-4b59-9162-ff1107650c97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7cb49c2b-d8b7-49df-956b-d47b255b5450"}], "security_groups": [{"name": "tempest-securitygroup--858079305"}], "key_name": "tempest-keypair-1965655660", "user_data": "}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:29.344881 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-f651b48e-b557-47ef-9d7e-081157a68a66 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:29.345377 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-f651b48e-b557-47ef-9d7e-081157a68a66 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:29.352317 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f651b48e-b557-47ef-9d7e-081157a68a66 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:29.352806 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f651b48e-b557-47ef-9d7e-081157a68a66 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:29.353587 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f651b48e-b557-47ef-9d7e-081157a68a66 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:29.354205 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f651b48e-b557-47ef-9d7e-081157a68a66 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:29.421549 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.network.neutron [None req-beb089be-e66e-44c8-85d6-c2caec74e536 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] validate_networks() for [('7cb49c2b-d8b7-49df-956b-d47b255b5450', None, None, None, None, None)] {{(pid=117399) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:23:29.458041 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.objects.instance [None req-f651b48e-b557-47ef-9d7e-081157a68a66 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lazy-loading 'services' on Instance uuid 3c1ceb67-3663-4d21-bf91-ab648bc249e0 {{(pid=117400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:23:29.650243 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-f651b48e-b557-47ef-9d7e-081157a68a66 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0/os-volume_attachments/2d933cc3-8679-44d9-b838-4ed55271c518" status: 202 len: 0 microversion: 2.1 time: 0.308982 May 10 03:23:29.650844 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 324/663] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 10 03:23:29 2022] DELETE /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0/os-volume_attachments/2d933cc3-8679-44d9-b838-4ed55271c518 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 03:23:29.660988 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-82b8a2c1-706c-4b24-aec8-a24e95a6dbb3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:29.660988 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-82b8a2c1-706c-4b24-aec8-a24e95a6dbb3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:29.667807 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-82b8a2c1-706c-4b24-aec8-a24e95a6dbb3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:29.668287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-82b8a2c1-706c-4b24-aec8-a24e95a6dbb3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:29.669350 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-82b8a2c1-706c-4b24-aec8-a24e95a6dbb3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:29.670310 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-82b8a2c1-706c-4b24-aec8-a24e95a6dbb3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:29.702130 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-82b8a2c1-706c-4b24-aec8-a24e95a6dbb3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046524 May 10 03:23:29.702730 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 325/664] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 03:23:29 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:23:30.289283 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-beb089be-e66e-44c8-85d6-c2caec74e536 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Flavor limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:23:30.289753 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-beb089be-e66e-44c8-85d6-c2caec74e536 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Image limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:23:30.290261 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-beb089be-e66e-44c8-85d6-c2caec74e536 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Flavor pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:23:30.290717 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-beb089be-e66e-44c8-85d6-c2caec74e536 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Image pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:23:30.291135 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-beb089be-e66e-44c8-85d6-c2caec74e536 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:23:30.300926 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-beb089be-e66e-44c8-85d6-c2caec74e536 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:30.302307 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-beb089be-e66e-44c8-85d6-c2caec74e536 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:30.302307 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-beb089be-e66e-44c8-85d6-c2caec74e536 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:30.302689 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-beb089be-e66e-44c8-85d6-c2caec74e536 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:30.319745 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-beb089be-e66e-44c8-85d6-c2caec74e536 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Getting quotas for project 813036cfbb6e4f1b93bbf75a982aa96f. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:23:30.323743 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-beb089be-e66e-44c8-85d6-c2caec74e536 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Getting quotas for user a14e317d371c4f9f994a568798c00e90 and project 813036cfbb6e4f1b93bbf75a982aa96f. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:23:30.335012 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-beb089be-e66e-44c8-85d6-c2caec74e536 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Going to run 1 instances... {{(pid=117399) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:23:30.337921 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-beb089be-e66e-44c8-85d6-c2caec74e536 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ce6e103-a571-4b59-9162-ff1107650c97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:23:30.486989 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-beb089be-e66e-44c8-85d6-c2caec74e536 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.231919 May 10 03:23:30.487641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 340/665] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 03:23:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 1235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:23:30.498254 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-943b86af-b693-4ca5-8368-1decce4c723b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:30.499462 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-943b86af-b693-4ca5-8368-1decce4c723b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:30.569205 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-943b86af-b693-4ca5-8368-1decce4c723b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:30.576527 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-943b86af-b693-4ca5-8368-1decce4c723b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 200 len: 1238 microversion: 2.1 time: 0.081975 May 10 03:23:30.577191 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 326/666] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:30 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:30.713174 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e7299a12-b22f-4073-bce3-2c893a82524f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:30.714897 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-e7299a12-b22f-4073-bce3-2c893a82524f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:30.722836 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e7299a12-b22f-4073-bce3-2c893a82524f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:30.723397 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e7299a12-b22f-4073-bce3-2c893a82524f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:30.724297 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e7299a12-b22f-4073-bce3-2c893a82524f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:30.724836 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e7299a12-b22f-4073-bce3-2c893a82524f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:30.741673 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-ed8414f6-7489-4bf7-8995-06ee94de4976 req-126a87af-9bd8-4da9-8a6d-6589af4d46ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a010d765-8dc4-44a9-922a-feabd172565b", "tag": "3d3f8b1a-cfaf-4bd6-babb-ab9bd3c7b319"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:30.754658 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-ed8414f6-7489-4bf7-8995-06ee94de4976 req-126a87af-9bd8-4da9-8a6d-6589af4d46ef service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:30.756094 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-ed8414f6-7489-4bf7-8995-06ee94de4976 req-126a87af-9bd8-4da9-8a6d-6589af4d46ef service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:30.757360 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-e7299a12-b22f-4073-bce3-2c893a82524f tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048209 May 10 03:23:30.757957 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 341/667] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 03:23:30 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:23:30.782110 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-ed8414f6-7489-4bf7-8995-06ee94de4976 req-126a87af-9bd8-4da9-8a6d-6589af4d46ef service nova] Creating event network-changed:3d3f8b1a-cfaf-4bd6-babb-ab9bd3c7b319 for instance a010d765-8dc4-44a9-922a-feabd172565b on hv-cinder-83009 May 10 03:23:30.788548 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-ed8414f6-7489-4bf7-8995-06ee94de4976 req-126a87af-9bd8-4da9-8a6d-6589af4d46ef service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053633 May 10 03:23:30.789443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 327/668] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:23:30.816915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-18d09df7-9a94-45dc-a025-0770a5f254e3 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:30.817847 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-18d09df7-9a94-45dc-a025-0770a5f254e3 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:30.826767 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-be5719af-77b0-4a47-9082-12f0fdfb0b56 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:30.831383 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-be5719af-77b0-4a47-9082-12f0fdfb0b56 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:30.831522 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-18d09df7-9a94-45dc-a025-0770a5f254e3 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:30.831522 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-18d09df7-9a94-45dc-a025-0770a5f254e3 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:30.831522 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-18d09df7-9a94-45dc-a025-0770a5f254e3 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:30.831522 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-18d09df7-9a94-45dc-a025-0770a5f254e3 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:30.835565 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-be5719af-77b0-4a47-9082-12f0fdfb0b56 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:30.836266 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-be5719af-77b0-4a47-9082-12f0fdfb0b56 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:30.837247 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-be5719af-77b0-4a47-9082-12f0fdfb0b56 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:30.837686 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-be5719af-77b0-4a47-9082-12f0fdfb0b56 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:30.863853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-be5719af-77b0-4a47-9082-12f0fdfb0b56 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Going to try to terminate instance {{(pid=117400) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:23:30.864166 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.objects.instance [None req-18d09df7-9a94-45dc-a025-0770a5f254e3 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lazy-loading 'flavor' on Instance uuid 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 {{(pid=117399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:23:31.182309 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-be5719af-77b0-4a47-9082-12f0fdfb0b56 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0" status: 204 len: 0 microversion: 2.1 time: 0.361709 May 10 03:23:31.182955 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 328/669] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:23:30 2022] DELETE /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:23:31.192688 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-47b9857c-41dd-4e30-8af2-5aa32384f1e9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:31.193391 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-47b9857c-41dd-4e30-8af2-5aa32384f1e9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:31.201223 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-47b9857c-41dd-4e30-8af2-5aa32384f1e9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:31.201977 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-47b9857c-41dd-4e30-8af2-5aa32384f1e9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:31.202872 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-47b9857c-41dd-4e30-8af2-5aa32384f1e9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:31.203340 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-47b9857c-41dd-4e30-8af2-5aa32384f1e9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:31.220779 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-18d09df7-9a94-45dc-a025-0770a5f254e3 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "POST /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8/action" status: 202 len: 0 microversion: 2.1 time: 0.411375 May 10 03:23:31.222604 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 342/670] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 03:23:30 2022] POST /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:23:31.234964 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ae06f2a2-70b4-40dd-86b5-9b1e495fab2d tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:31.235990 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ae06f2a2-70b4-40dd-86b5-9b1e495fab2d tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:31.245947 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ae06f2a2-70b4-40dd-86b5-9b1e495fab2d tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:31.246633 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ae06f2a2-70b4-40dd-86b5-9b1e495fab2d tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:31.248882 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ae06f2a2-70b4-40dd-86b5-9b1e495fab2d tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:31.249552 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ae06f2a2-70b4-40dd-86b5-9b1e495fab2d tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:31.427543 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-47b9857c-41dd-4e30-8af2-5aa32384f1e9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:31.437114 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-47b9857c-41dd-4e30-8af2-5aa32384f1e9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0" status: 200 len: 1681 microversion: 2.1 time: 0.248686 May 10 03:23:31.443647 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 329/671] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:31 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 => generated 1681 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:31.443943 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ae06f2a2-70b4-40dd-86b5-9b1e495fab2d tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:31.449966 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ae06f2a2-70b4-40dd-86b5-9b1e495fab2d tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1570 microversion: 2.1 time: 0.222429 May 10 03:23:31.450736 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 343/672] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:31 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1570 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:31.593300 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-95d64c66-b422-476f-aae9-abae3d6a1d24 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:31.593861 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-95d64c66-b422-476f-aae9-abae3d6a1d24 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:31.600424 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-95d64c66-b422-476f-aae9-abae3d6a1d24 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:31.600872 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-95d64c66-b422-476f-aae9-abae3d6a1d24 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:31.601640 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-95d64c66-b422-476f-aae9-abae3d6a1d24 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:31.602074 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-95d64c66-b422-476f-aae9-abae3d6a1d24 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:31.665768 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-95d64c66-b422-476f-aae9-abae3d6a1d24 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:31.673975 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-95d64c66-b422-476f-aae9-abae3d6a1d24 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 200 len: 1242 microversion: 2.1 time: 0.085090 May 10 03:23:31.674535 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 330/673] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:31 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:32.457179 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-2c7dcba9-19df-4a5b-877c-260b39086298 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:32.457781 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-2c7dcba9-19df-4a5b-877c-260b39086298 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:32.464159 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2c7dcba9-19df-4a5b-877c-260b39086298 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:32.464605 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2c7dcba9-19df-4a5b-877c-260b39086298 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:32.465367 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2c7dcba9-19df-4a5b-877c-260b39086298 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:32.465803 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2c7dcba9-19df-4a5b-877c-260b39086298 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:32.466358 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-098660e6-c1f6-4718-9f9b-9f117244f519 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:32.466993 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-098660e6-c1f6-4718-9f9b-9f117244f519 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:32.473167 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-098660e6-c1f6-4718-9f9b-9f117244f519 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:32.473620 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-098660e6-c1f6-4718-9f9b-9f117244f519 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:32.474987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-098660e6-c1f6-4718-9f9b-9f117244f519 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:32.475468 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-098660e6-c1f6-4718-9f9b-9f117244f519 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:32.663344 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-2c7dcba9-19df-4a5b-877c-260b39086298 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:32.672404 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-2c7dcba9-19df-4a5b-877c-260b39086298 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0" status: 200 len: 1681 microversion: 2.1 time: 0.219022 May 10 03:23:32.672994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 344/674] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:32 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 => generated 1681 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:32.674397 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-098660e6-c1f6-4718-9f9b-9f117244f519 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:32.683041 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-098660e6-c1f6-4718-9f9b-9f117244f519 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1570 microversion: 2.1 time: 0.220348 May 10 03:23:32.683644 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 331/675] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:32 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1570 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:32.691058 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-6b6707e1-3c55-4ad6-9047-2211b0d07517 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:32.692174 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-6b6707e1-3c55-4ad6-9047-2211b0d07517 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:32.699234 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6b6707e1-3c55-4ad6-9047-2211b0d07517 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:32.699813 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6b6707e1-3c55-4ad6-9047-2211b0d07517 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:32.700635 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6b6707e1-3c55-4ad6-9047-2211b0d07517 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:32.701075 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6b6707e1-3c55-4ad6-9047-2211b0d07517 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:32.761178 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-6b6707e1-3c55-4ad6-9047-2211b0d07517 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:32.768489 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-6b6707e1-3c55-4ad6-9047-2211b0d07517 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 200 len: 1242 microversion: 2.1 time: 0.081365 May 10 03:23:32.769060 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 345/676] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:32 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:32.803888 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-10d19ef9-1149-4abd-9fb3-b25c860d51f2 req-9ccd5c06-b453-43c0-bf96-32ca1df1163c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a010d765-8dc4-44a9-922a-feabd172565b", "tag": "3d3f8b1a-cfaf-4bd6-babb-ab9bd3c7b319"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:32.812424 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-10d19ef9-1149-4abd-9fb3-b25c860d51f2 req-9ccd5c06-b453-43c0-bf96-32ca1df1163c service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:32.812865 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-10d19ef9-1149-4abd-9fb3-b25c860d51f2 req-9ccd5c06-b453-43c0-bf96-32ca1df1163c service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:32.823824 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-10d19ef9-1149-4abd-9fb3-b25c860d51f2 req-9ccd5c06-b453-43c0-bf96-32ca1df1163c service nova] Creating event network-changed:3d3f8b1a-cfaf-4bd6-babb-ab9bd3c7b319 for instance a010d765-8dc4-44a9-922a-feabd172565b on hv-cinder-83009 May 10 03:23:32.828768 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-10d19ef9-1149-4abd-9fb3-b25c860d51f2 req-9ccd5c06-b453-43c0-bf96-32ca1df1163c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028891 May 10 03:23:32.829354 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 332/677] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:33.689731 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ddc5a7dc-18d6-4d9d-8af1-a982b9cf1d3c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:33.691269 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ddc5a7dc-18d6-4d9d-8af1-a982b9cf1d3c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:33.697876 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ddc5a7dc-18d6-4d9d-8af1-a982b9cf1d3c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:33.698406 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ddc5a7dc-18d6-4d9d-8af1-a982b9cf1d3c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:33.699251 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ddc5a7dc-18d6-4d9d-8af1-a982b9cf1d3c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:33.699694 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ddc5a7dc-18d6-4d9d-8af1-a982b9cf1d3c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:33.711225 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-d57d0688-612e-482c-abf7-ace7237423f2 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:33.711914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-d57d0688-612e-482c-abf7-ace7237423f2 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:33.719004 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d57d0688-612e-482c-abf7-ace7237423f2 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:33.719463 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d57d0688-612e-482c-abf7-ace7237423f2 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:33.720269 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d57d0688-612e-482c-abf7-ace7237423f2 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:33.721199 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d57d0688-612e-482c-abf7-ace7237423f2 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:33.793228 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ddc5a7dc-18d6-4d9d-8af1-a982b9cf1d3c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:33.801604 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ddc5a7dc-18d6-4d9d-8af1-a982b9cf1d3c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0" status: 200 len: 1614 microversion: 2.1 time: 0.115654 May 10 03:23:33.802317 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 346/678] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:33 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 => generated 1614 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:33.817027 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-93e7cc0f-a3f3-4550-9057-a9a30529186b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:33.817772 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-93e7cc0f-a3f3-4550-9057-a9a30529186b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:33.824182 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-93e7cc0f-a3f3-4550-9057-a9a30529186b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:33.824753 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-93e7cc0f-a3f3-4550-9057-a9a30529186b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:33.825768 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-93e7cc0f-a3f3-4550-9057-a9a30529186b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:33.826302 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-93e7cc0f-a3f3-4550-9057-a9a30529186b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:33.909180 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-93e7cc0f-a3f3-4550-9057-a9a30529186b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:33.913688 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-d57d0688-612e-482c-abf7-ace7237423f2 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:33.917203 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-93e7cc0f-a3f3-4550-9057-a9a30529186b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 200 len: 1298 microversion: 2.1 time: 0.103876 May 10 03:23:33.918154 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 347/679] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:33 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:33.923813 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-d57d0688-612e-482c-abf7-ace7237423f2 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1570 microversion: 2.1 time: 0.217405 May 10 03:23:33.934484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 333/680] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:33 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1570 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:34.588238 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-81cd1a28-09f8-4345-9dc3-18b8ae7e1206 req-21a396ee-60b4-4802-a7ce-58696a09f148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c1ceb67-3663-4d21-bf91-ab648bc249e0", "name": "network-vif-deleted", "tag": "f493a15e-bd36-4dd2-b7df-1cd2f38b4180"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:34.597598 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-81cd1a28-09f8-4345-9dc3-18b8ae7e1206 req-21a396ee-60b4-4802-a7ce-58696a09f148 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:34.598853 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-81cd1a28-09f8-4345-9dc3-18b8ae7e1206 req-21a396ee-60b4-4802-a7ce-58696a09f148 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:34.612770 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-81cd1a28-09f8-4345-9dc3-18b8ae7e1206 req-21a396ee-60b4-4802-a7ce-58696a09f148 service nova] Creating event network-vif-deleted:f493a15e-bd36-4dd2-b7df-1cd2f38b4180 for instance 3c1ceb67-3663-4d21-bf91-ab648bc249e0 on hv-cinder-83009 May 10 03:23:34.620048 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-81cd1a28-09f8-4345-9dc3-18b8ae7e1206 req-21a396ee-60b4-4802-a7ce-58696a09f148 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038225 May 10 03:23:34.622860 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 348/681] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:34.818987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-7ece5df6-0624-46a9-b614-9d1744498eb4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:34.819783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-7ece5df6-0624-46a9-b614-9d1744498eb4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:34.826415 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7ece5df6-0624-46a9-b614-9d1744498eb4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:34.827698 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7ece5df6-0624-46a9-b614-9d1744498eb4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:34.828659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7ece5df6-0624-46a9-b614-9d1744498eb4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:34.829304 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7ece5df6-0624-46a9-b614-9d1744498eb4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:34.882056 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7ece5df6-0624-46a9-b614-9d1744498eb4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:34.882056 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7ece5df6-0624-46a9-b614-9d1744498eb4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:34.882371 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.objects.instance [None req-7ece5df6-0624-46a9-b614-9d1744498eb4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lazy-loading 'fault' on Instance uuid 3c1ceb67-3663-4d21-bf91-ab648bc249e0 {{(pid=117400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:23:34.938279 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-b579745d-e656-44c6-87b7-f915a21e2a16 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:34.939562 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-b579745d-e656-44c6-87b7-f915a21e2a16 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:34.946677 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b579745d-e656-44c6-87b7-f915a21e2a16 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:34.947132 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b579745d-e656-44c6-87b7-f915a21e2a16 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:34.950422 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-7ece5df6-0624-46a9-b614-9d1744498eb4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:34.953280 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b579745d-e656-44c6-87b7-f915a21e2a16 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:34.953979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b579745d-e656-44c6-87b7-f915a21e2a16 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:34.957758 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-7ece5df6-0624-46a9-b614-9d1744498eb4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0" status: 200 len: 1332 microversion: 2.1 time: 0.142927 May 10 03:23:34.958336 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 334/682] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:34 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 => generated 1332 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:34.962895 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-c77c559c-3827-4364-af25-aceaa5b5a564 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:34.963691 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-c77c559c-3827-4364-af25-aceaa5b5a564 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:34.969734 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c77c559c-3827-4364-af25-aceaa5b5a564 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:34.970193 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c77c559c-3827-4364-af25-aceaa5b5a564 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:34.970979 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c77c559c-3827-4364-af25-aceaa5b5a564 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:34.971420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c77c559c-3827-4364-af25-aceaa5b5a564 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:35.040599 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-b579745d-e656-44c6-87b7-f915a21e2a16 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:35.050143 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-b579745d-e656-44c6-87b7-f915a21e2a16 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 200 len: 1296 microversion: 2.1 time: 0.119490 May 10 03:23:35.051325 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 349/683] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:34 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 1296 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:35.146716 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-c77c559c-3827-4364-af25-aceaa5b5a564 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:35.154592 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-c77c559c-3827-4364-af25-aceaa5b5a564 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1570 microversion: 2.1 time: 0.195092 May 10 03:23:35.155438 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 335/684] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:34 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1570 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:35.974721 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-29821580-fcec-4a7e-9c00-ded14ca2dd40 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:35.975308 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-29821580-fcec-4a7e-9c00-ded14ca2dd40 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:35.981848 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-29821580-fcec-4a7e-9c00-ded14ca2dd40 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:35.982370 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-29821580-fcec-4a7e-9c00-ded14ca2dd40 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:35.989727 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-29821580-fcec-4a7e-9c00-ded14ca2dd40 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:35.989727 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-29821580-fcec-4a7e-9c00-ded14ca2dd40 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:35.998615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-29821580-fcec-4a7e-9c00-ded14ca2dd40 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] HTTP exception thrown: Instance 3c1ceb67-3663-4d21-bf91-ab648bc249e0 could not be found. May 10 03:23:36.000341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-29821580-fcec-4a7e-9c00-ded14ca2dd40 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Request method failure captured: May 10 03:23:36.000341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 HTTP/1.1 May 10 03:23:36.000341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:23:36.000341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:23:36.000341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:23:36.000341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:23:36.000341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:23:36.000341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:23:36.000341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:23:36.000341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:23:36.000341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedm7QRYCgCmNpOHEq-xocEssXcoKFt3Cw-xUSJVkpdbWkcE2a4swkD5OOWo0sIcmaGXBYMa4anhP-9-xwsnmr7TD0HDae0_ZejhV9Z7LARWPFLjL5ozyZp775dsZG_BfqUR5n4ZQlWeOoqrl2-8Sk1TTVheuLGMVx-c_z5Xm6ARd90Q May 10 03:23:36.000341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:23:36.000341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:23:36.000341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:23:36.000341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:23:36.000341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:23:36.000341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:23:36.000341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:23:36.000341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:23:36.000341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:23:36.000341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:23:36.001783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b7c607953b94c02977d60c0b0536e24", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b7c607953b94c02977d60c0b0536e24"}]}] May 10 03:23:36.001783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:23:36.001783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:23:36.001783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:23:36.001783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:23:36.001783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:23:36.001783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:23:36.001783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: 9407e88fdbd74ba196ffd9fd221e15f5 May 10 03:23:36.001783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:23:36.001783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: > May 10 03:23:36.001783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Instance 3c1ceb67-3663-4d21-bf91-ab648bc249e0 could not be found. May 10 03:23:36.001783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': '3c1ceb67-3663-4d21-bf91-ab648bc249e0'} May 10 03:23:36.002737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:23:36.002737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:23:36.002737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:23:36.002737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:23:36.002737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:23:36.002737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:23:36.002737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:23:36.002737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:23:36.002737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:23:36.002737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:23:36.002737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c1ceb67-3663-4d21-bf91-ab648bc249e0 could not be found. May 10 03:23:36.002737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:23:36.002737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:23:36.002737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:23:36.002737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:23:36.002737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:23:36.002737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:23:36.002737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:23:36.002737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:23:36.002737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:23:36.004237 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:23:36.004237 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:23:36.004237 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:23:36.004237 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:23:36.004237 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:23:36.004237 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:23:36.004237 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:23:36.004237 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c1ceb67-3663-4d21-bf91-ab648bc249e0 could not be found. May 10 03:23:36.004237 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:23:36.004237 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:23:36.004237 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:23:36.004237 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:23:36.004237 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:23:36.004237 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:23:36.004237 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:23:36.004237 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:23:36.004237 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c1ceb67-3663-4d21-bf91-ab648bc249e0 could not be found. May 10 03:23:36.004237 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:23:36.005666 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-29821580-fcec-4a7e-9c00-ded14ca2dd40 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Returning 404 to user: Instance 3c1ceb67-3663-4d21-bf91-ab648bc249e0 could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:23:36.005666 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-29821580-fcec-4a7e-9c00-ded14ca2dd40 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0" status: 404 len: 111 microversion: 2.1 time: 0.031000 May 10 03:23:36.012086 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 350/685] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:35 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:23:36.012469 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-0581df95-158c-4192-a390-852fb8b1464a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '.version_select at 0x7f6a5d12edc0>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:36.067908 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-10b521c5-e1a5-4d24-b41a-cc04d76ed853 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:36.068584 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-10b521c5-e1a5-4d24-b41a-cc04d76ed853 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:36.074917 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-10b521c5-e1a5-4d24-b41a-cc04d76ed853 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:36.075374 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-10b521c5-e1a5-4d24-b41a-cc04d76ed853 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:36.076341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-10b521c5-e1a5-4d24-b41a-cc04d76ed853 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:36.077350 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-10b521c5-e1a5-4d24-b41a-cc04d76ed853 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:36.144156 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-0581df95-158c-4192-a390-852fb8b1464a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898385862" status: 202 len: 0 microversion: 2.1 time: 0.136293 May 10 03:23:36.145087 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 336/686] 10.222.0.65 () {58 vars in 1220 bytes} [Tue May 10 03:23:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898385862 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:23:36.172315 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-e05a41fb-4771-4a55-af15-f76fd86ed540 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:36.173181 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-e05a41fb-4771-4a55-af15-f76fd86ed540 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:36.180336 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e05a41fb-4771-4a55-af15-f76fd86ed540 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:36.181119 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e05a41fb-4771-4a55-af15-f76fd86ed540 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:36.182068 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e05a41fb-4771-4a55-af15-f76fd86ed540 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:36.182681 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e05a41fb-4771-4a55-af15-f76fd86ed540 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:36.292503 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-10b521c5-e1a5-4d24-b41a-cc04d76ed853 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:36.302105 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-10b521c5-e1a5-4d24-b41a-cc04d76ed853 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 200 len: 1363 microversion: 2.1 time: 0.237903 May 10 03:23:36.302596 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 351/687] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:36 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:36.402831 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-e05a41fb-4771-4a55-af15-f76fd86ed540 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:36.410464 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-e05a41fb-4771-4a55-af15-f76fd86ed540 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1570 microversion: 2.1 time: 0.242399 May 10 03:23:36.411752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 337/688] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:36 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1570 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:36.634456 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-cc2940a7-79a2-461f-ab7e-93d34a6a5c09 req-4411ee66-c57c-4ced-8b2a-073c4111c768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9adf1a01-7c6f-4ad0-8b62-643d71caec83", "tag": "0f87c033-180b-41b9-bec8-9f6abee088d9"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:36.642585 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-cc2940a7-79a2-461f-ab7e-93d34a6a5c09 req-4411ee66-c57c-4ced-8b2a-073c4111c768 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:36.643024 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-cc2940a7-79a2-461f-ab7e-93d34a6a5c09 req-4411ee66-c57c-4ced-8b2a-073c4111c768 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:36.654117 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-cc2940a7-79a2-461f-ab7e-93d34a6a5c09 req-4411ee66-c57c-4ced-8b2a-073c4111c768 service nova] Creating event network-changed:0f87c033-180b-41b9-bec8-9f6abee088d9 for instance 9adf1a01-7c6f-4ad0-8b62-643d71caec83 on hv-cinder-83009 May 10 03:23:36.658977 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-cc2940a7-79a2-461f-ab7e-93d34a6a5c09 req-4411ee66-c57c-4ced-8b2a-073c4111c768 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028329 May 10 03:23:36.659582 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 352/689] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:37.041607 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-120dd463-633b-4b94-9b55-e3c765bf0dc0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Action: 'create', calling method: .version_select at 0x7f6a5d12e280>, body: {"keypair": {"name": "tempest-keypair-873176578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0rGTTN+nvtcWj0Rteh4qs5wGfuBSMvRauT+w4QCbcFDxGTTtzOtaTnAxbSvX7BP9kFEdAskTv2QDvURBPjpKQYgpaW9nrIGD2OmcyDzzguZTMzZHroBV+nN3HKiaWzhg=="}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:37.056357 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-120dd463-633b-4b94-9b55-e3c765bf0dc0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Getting quotas for project 0b7c607953b94c02977d60c0b0536e24. Resources: {'key_pairs'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:23:37.060080 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-120dd463-633b-4b94-9b55-e3c765bf0dc0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Getting quotas for user 9407e88fdbd74ba196ffd9fd221e15f5 and project 0b7c607953b94c02977d60c0b0536e24. Resources: {'key_pairs'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:23:37.165576 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-120dd463-633b-4b94-9b55-e3c765bf0dc0 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.127800 May 10 03:23:37.166128 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 338/690] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 10 03:23:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:37.319193 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-271e07ba-7f61-425f-9c75-a24b318428ba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:37.319895 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-271e07ba-7f61-425f-9c75-a24b318428ba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:37.326473 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-271e07ba-7f61-425f-9c75-a24b318428ba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:37.327429 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-271e07ba-7f61-425f-9c75-a24b318428ba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:37.328238 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-271e07ba-7f61-425f-9c75-a24b318428ba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:37.328802 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-271e07ba-7f61-425f-9c75-a24b318428ba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:37.429883 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-4ef0fae6-ac5b-4966-ae82-e5c444063173 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:37.429883 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-4ef0fae6-ac5b-4966-ae82-e5c444063173 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:37.435664 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4ef0fae6-ac5b-4966-ae82-e5c444063173 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:37.436193 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4ef0fae6-ac5b-4966-ae82-e5c444063173 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:37.436957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4ef0fae6-ac5b-4966-ae82-e5c444063173 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:37.437389 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4ef0fae6-ac5b-4966-ae82-e5c444063173 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:37.498313 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-271e07ba-7f61-425f-9c75-a24b318428ba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:37.508245 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-271e07ba-7f61-425f-9c75-a24b318428ba tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 200 len: 1363 microversion: 2.1 time: 0.193132 May 10 03:23:37.508840 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 353/691] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:37 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:37.596520 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-4ef0fae6-ac5b-4966-ae82-e5c444063173 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:37.603915 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-4ef0fae6-ac5b-4966-ae82-e5c444063173 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1570 microversion: 2.1 time: 0.178674 May 10 03:23:37.604542 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 339/692] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:37 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:38.525277 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-0ab7a336-39e6-46c2-b3fc-a54202dc45b0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:38.525936 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-0ab7a336-39e6-46c2-b3fc-a54202dc45b0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:38.532826 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0ab7a336-39e6-46c2-b3fc-a54202dc45b0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:38.533290 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0ab7a336-39e6-46c2-b3fc-a54202dc45b0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:38.534064 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0ab7a336-39e6-46c2-b3fc-a54202dc45b0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:38.534507 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0ab7a336-39e6-46c2-b3fc-a54202dc45b0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:38.620753 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-468a1baf-c62d-4fb7-bb65-489c32841a52 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:38.622183 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-468a1baf-c62d-4fb7-bb65-489c32841a52 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:38.629416 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-468a1baf-c62d-4fb7-bb65-489c32841a52 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:38.630118 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-468a1baf-c62d-4fb7-bb65-489c32841a52 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:38.630905 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-468a1baf-c62d-4fb7-bb65-489c32841a52 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:38.631348 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-468a1baf-c62d-4fb7-bb65-489c32841a52 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:38.670119 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-0ab7a336-39e6-46c2-b3fc-a54202dc45b0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:38.678298 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-0ab7a336-39e6-46c2-b3fc-a54202dc45b0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 200 len: 1363 microversion: 2.1 time: 0.156847 May 10 03:23:38.678896 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 354/693] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:38 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:38.769727 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-468a1baf-c62d-4fb7-bb65-489c32841a52 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:38.777309 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-468a1baf-c62d-4fb7-bb65-489c32841a52 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1570 microversion: 2.1 time: 0.160339 May 10 03:23:38.777810 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 340/694] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:38 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:39.544797 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-2bc539a1-47f0-4e9c-87fa-9110e4bbd088 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2131814348", "imageRef": "7ce6e103-a571-4b59-9162-ff1107650c97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1e0211ea-07f5-489a-bffd-a2279bfba53a"}], "security_groups": [{"name": "tempest-securitygroup--31905917"}], "key_name": "tempest-keypair-873176578", "user_data": "}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:39.646712 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.network.neutron [None req-2bc539a1-47f0-4e9c-87fa-9110e4bbd088 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] validate_networks() for [('1e0211ea-07f5-489a-bffd-a2279bfba53a', None, None, None, None, None)] {{(pid=117399) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:23:39.694596 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-f44d707c-a01e-4c46-9aab-b7b415016a5c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:39.695229 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-f44d707c-a01e-4c46-9aab-b7b415016a5c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:39.701546 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f44d707c-a01e-4c46-9aab-b7b415016a5c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:39.701977 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f44d707c-a01e-4c46-9aab-b7b415016a5c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:39.702786 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f44d707c-a01e-4c46-9aab-b7b415016a5c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:39.703221 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f44d707c-a01e-4c46-9aab-b7b415016a5c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:39.905389 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-f44d707c-a01e-4c46-9aab-b7b415016a5c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:39.912654 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-f44d707c-a01e-4c46-9aab-b7b415016a5c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 200 len: 1363 microversion: 2.1 time: 0.221967 May 10 03:23:39.913231 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 341/695] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:39 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:39.917524 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-737f408e-0e5f-48a8-8c19-daefa7cac4d3 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:39.918771 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-737f408e-0e5f-48a8-8c19-daefa7cac4d3 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:39.925229 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-737f408e-0e5f-48a8-8c19-daefa7cac4d3 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:39.925684 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-737f408e-0e5f-48a8-8c19-daefa7cac4d3 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:39.926454 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-737f408e-0e5f-48a8-8c19-daefa7cac4d3 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:39.926892 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-737f408e-0e5f-48a8-8c19-daefa7cac4d3 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:40.126714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-2bc539a1-47f0-4e9c-87fa-9110e4bbd088 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Flavor limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:23:40.127214 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-2bc539a1-47f0-4e9c-87fa-9110e4bbd088 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Image limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:23:40.127767 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-2bc539a1-47f0-4e9c-87fa-9110e4bbd088 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Flavor pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:23:40.128351 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-2bc539a1-47f0-4e9c-87fa-9110e4bbd088 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Image pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:23:40.128836 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-2bc539a1-47f0-4e9c-87fa-9110e4bbd088 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:23:40.130832 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-737f408e-0e5f-48a8-8c19-daefa7cac4d3 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:40.138245 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-737f408e-0e5f-48a8-8c19-daefa7cac4d3 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1570 microversion: 2.1 time: 0.224062 May 10 03:23:40.139542 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 342/696] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:39 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1570 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:40.139668 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2bc539a1-47f0-4e9c-87fa-9110e4bbd088 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:40.139914 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2bc539a1-47f0-4e9c-87fa-9110e4bbd088 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:40.140751 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2bc539a1-47f0-4e9c-87fa-9110e4bbd088 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:40.141188 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2bc539a1-47f0-4e9c-87fa-9110e4bbd088 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:40.158367 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-2bc539a1-47f0-4e9c-87fa-9110e4bbd088 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Getting quotas for project 0b7c607953b94c02977d60c0b0536e24. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:23:40.162220 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-2bc539a1-47f0-4e9c-87fa-9110e4bbd088 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Getting quotas for user 9407e88fdbd74ba196ffd9fd221e15f5 and project 0b7c607953b94c02977d60c0b0536e24. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:23:40.173068 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-2bc539a1-47f0-4e9c-87fa-9110e4bbd088 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Going to run 1 instances... {{(pid=117399) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:23:40.175365 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-2bc539a1-47f0-4e9c-87fa-9110e4bbd088 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ce6e103-a571-4b59-9162-ff1107650c97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:23:40.343531 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-2bc539a1-47f0-4e9c-87fa-9110e4bbd088 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.803842 May 10 03:23:40.344469 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 355/697] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 03:23:39 2022] POST /compute/v2.1/servers => generated 400 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:23:40.354703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-c596e1d1-9031-44e6-b440-8a7d956594ac tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:40.355494 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-c596e1d1-9031-44e6-b440-8a7d956594ac tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:40.416242 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-c596e1d1-9031-44e6-b440-8a7d956594ac tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:40.425318 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-c596e1d1-9031-44e6-b440-8a7d956594ac tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827" status: 200 len: 1241 microversion: 2.1 time: 0.074515 May 10 03:23:40.434702 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 343/698] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:40 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:40.930844 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c1a2424f-312d-4287-bb20-b7a98451059a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:40.931469 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-c1a2424f-312d-4287-bb20-b7a98451059a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:40.938664 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c1a2424f-312d-4287-bb20-b7a98451059a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:40.939120 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c1a2424f-312d-4287-bb20-b7a98451059a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:40.939894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c1a2424f-312d-4287-bb20-b7a98451059a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:40.940374 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c1a2424f-312d-4287-bb20-b7a98451059a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:41.069247 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-c1a2424f-312d-4287-bb20-b7a98451059a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:41.076609 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-c1a2424f-312d-4287-bb20-b7a98451059a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 200 len: 1363 microversion: 2.1 time: 0.150156 May 10 03:23:41.077170 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 356/699] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:40 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:41.154730 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-d58b6ec5-4b3a-4c6b-9284-57d6323b1d34 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:41.155347 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-d58b6ec5-4b3a-4c6b-9284-57d6323b1d34 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:41.162595 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d58b6ec5-4b3a-4c6b-9284-57d6323b1d34 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:41.163052 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d58b6ec5-4b3a-4c6b-9284-57d6323b1d34 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:41.163839 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d58b6ec5-4b3a-4c6b-9284-57d6323b1d34 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:41.164319 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d58b6ec5-4b3a-4c6b-9284-57d6323b1d34 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:41.293653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-d58b6ec5-4b3a-4c6b-9284-57d6323b1d34 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:41.302349 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-d58b6ec5-4b3a-4c6b-9284-57d6323b1d34 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1570 microversion: 2.1 time: 0.151672 May 10 03:23:41.302918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 344/700] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:41 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:41.442133 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-59a21e01-75c6-40a5-bad4-0b06cc39c222 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:41.442894 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-59a21e01-75c6-40a5-bad4-0b06cc39c222 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:41.448875 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-59a21e01-75c6-40a5-bad4-0b06cc39c222 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:41.449326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-59a21e01-75c6-40a5-bad4-0b06cc39c222 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:41.450096 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-59a21e01-75c6-40a5-bad4-0b06cc39c222 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:41.450542 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-59a21e01-75c6-40a5-bad4-0b06cc39c222 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:41.524688 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-59a21e01-75c6-40a5-bad4-0b06cc39c222 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:41.532495 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-59a21e01-75c6-40a5-bad4-0b06cc39c222 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827" status: 200 len: 1237 microversion: 2.1 time: 0.094142 May 10 03:23:41.533057 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 357/701] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:41 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 => generated 1237 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:42.093304 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-1ecc6af6-764a-441c-89ef-7b8d968e4fe9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:42.094025 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-1ecc6af6-764a-441c-89ef-7b8d968e4fe9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:42.099880 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1ecc6af6-764a-441c-89ef-7b8d968e4fe9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:42.100361 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1ecc6af6-764a-441c-89ef-7b8d968e4fe9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:42.101132 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1ecc6af6-764a-441c-89ef-7b8d968e4fe9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:42.101570 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1ecc6af6-764a-441c-89ef-7b8d968e4fe9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:42.231584 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1ecc6af6-764a-441c-89ef-7b8d968e4fe9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:42.239002 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-1ecc6af6-764a-441c-89ef-7b8d968e4fe9 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 200 len: 1363 microversion: 2.1 time: 0.149585 May 10 03:23:42.239580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 345/702] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:42 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:42.318717 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-67627ee8-d665-4831-907a-0bda133526fd tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:42.319334 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-67627ee8-d665-4831-907a-0bda133526fd tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:42.326192 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-67627ee8-d665-4831-907a-0bda133526fd tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:42.327486 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-67627ee8-d665-4831-907a-0bda133526fd tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:42.334280 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-67627ee8-d665-4831-907a-0bda133526fd tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:42.334280 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-67627ee8-d665-4831-907a-0bda133526fd tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:42.439870 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-e0bba25c-2d6a-492a-b414-aefaa2d89136 req-386edec2-fa18-4a1e-9a67-626f5ff5ee5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9adf1a01-7c6f-4ad0-8b62-643d71caec83", "name": "network-vif-plugged", "status": "completed", "tag": "0f87c033-180b-41b9-bec8-9f6abee088d9"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:42.453031 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-e0bba25c-2d6a-492a-b414-aefaa2d89136 req-386edec2-fa18-4a1e-9a67-626f5ff5ee5c service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:42.457092 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-e0bba25c-2d6a-492a-b414-aefaa2d89136 req-386edec2-fa18-4a1e-9a67-626f5ff5ee5c service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:42.473669 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-e0bba25c-2d6a-492a-b414-aefaa2d89136 req-386edec2-fa18-4a1e-9a67-626f5ff5ee5c service nova] Creating event network-vif-plugged:0f87c033-180b-41b9-bec8-9f6abee088d9 for instance 9adf1a01-7c6f-4ad0-8b62-643d71caec83 on hv-cinder-83009 May 10 03:23:42.480031 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-e0bba25c-2d6a-492a-b414-aefaa2d89136 req-386edec2-fa18-4a1e-9a67-626f5ff5ee5c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049657 May 10 03:23:42.481253 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 346/703] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:42.490558 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-67627ee8-d665-4831-907a-0bda133526fd tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:42.498300 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-67627ee8-d665-4831-907a-0bda133526fd tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1570 microversion: 2.1 time: 0.183513 May 10 03:23:42.500614 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 358/704] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:42 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:42.551316 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-bff9e5af-38fa-4ecf-8472-2b447c66a392 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:42.552169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-bff9e5af-38fa-4ecf-8472-2b447c66a392 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:42.558707 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bff9e5af-38fa-4ecf-8472-2b447c66a392 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:42.560121 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bff9e5af-38fa-4ecf-8472-2b447c66a392 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:42.561640 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bff9e5af-38fa-4ecf-8472-2b447c66a392 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:42.562125 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bff9e5af-38fa-4ecf-8472-2b447c66a392 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:42.629486 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-bff9e5af-38fa-4ecf-8472-2b447c66a392 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:42.637198 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-bff9e5af-38fa-4ecf-8472-2b447c66a392 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827" status: 200 len: 1299 microversion: 2.1 time: 0.090316 May 10 03:23:42.637996 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 347/705] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:42 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:43.256357 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e583904c-9051-40ab-b28b-37f013cc883f tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:43.256974 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-e583904c-9051-40ab-b28b-37f013cc883f tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:43.263831 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e583904c-9051-40ab-b28b-37f013cc883f tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:43.264828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e583904c-9051-40ab-b28b-37f013cc883f tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:43.265637 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e583904c-9051-40ab-b28b-37f013cc883f tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:43.266104 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e583904c-9051-40ab-b28b-37f013cc883f tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:43.393163 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-e583904c-9051-40ab-b28b-37f013cc883f tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:43.400953 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-e583904c-9051-40ab-b28b-37f013cc883f tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 200 len: 1363 microversion: 2.1 time: 0.148865 May 10 03:23:43.402856 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 359/706] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:43 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:43.517332 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-3b0bf1f1-dad7-490f-b4c8-de26507ff2da tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:43.517970 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-3b0bf1f1-dad7-490f-b4c8-de26507ff2da tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:43.524776 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3b0bf1f1-dad7-490f-b4c8-de26507ff2da tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:43.525222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3b0bf1f1-dad7-490f-b4c8-de26507ff2da tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:43.526009 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3b0bf1f1-dad7-490f-b4c8-de26507ff2da tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:43.526448 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3b0bf1f1-dad7-490f-b4c8-de26507ff2da tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:43.654848 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-dc5b2361-7a19-4981-b8af-63edd4cff215 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:43.655383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-dc5b2361-7a19-4981-b8af-63edd4cff215 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:43.661145 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-3b0bf1f1-dad7-490f-b4c8-de26507ff2da tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:43.667456 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dc5b2361-7a19-4981-b8af-63edd4cff215 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:43.667901 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dc5b2361-7a19-4981-b8af-63edd4cff215 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:43.668705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dc5b2361-7a19-4981-b8af-63edd4cff215 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:43.669027 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-3b0bf1f1-dad7-490f-b4c8-de26507ff2da tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1570 microversion: 2.1 time: 0.156163 May 10 03:23:43.669163 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dc5b2361-7a19-4981-b8af-63edd4cff215 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:43.670199 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 348/707] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:43 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:43.800506 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-dc5b2361-7a19-4981-b8af-63edd4cff215 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:43.807833 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-dc5b2361-7a19-4981-b8af-63edd4cff215 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827" status: 200 len: 1365 microversion: 2.1 time: 0.157140 May 10 03:23:43.808522 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 360/708] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:43 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:44.418178 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-03b8c200-a7c4-4cbc-b3e1-dd168138efb0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:44.418979 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-03b8c200-a7c4-4cbc-b3e1-dd168138efb0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:44.425798 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-03b8c200-a7c4-4cbc-b3e1-dd168138efb0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:44.426259 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-03b8c200-a7c4-4cbc-b3e1-dd168138efb0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:44.427045 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-03b8c200-a7c4-4cbc-b3e1-dd168138efb0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:44.427507 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-03b8c200-a7c4-4cbc-b3e1-dd168138efb0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:44.552378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-b21e5789-ff05-47ca-b6d2-057221664af7 req-674de0bc-4751-4f70-b8bd-03ba81f43591 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87dd0c55-5fe5-4ea8-80f3-fd4af00ad827", "tag": "af3cf7e3-6eaf-4eb8-97db-23b35c82abb6"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:44.558364 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-03b8c200-a7c4-4cbc-b3e1-dd168138efb0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:44.566245 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-b21e5789-ff05-47ca-b6d2-057221664af7 req-674de0bc-4751-4f70-b8bd-03ba81f43591 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:44.566681 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-b21e5789-ff05-47ca-b6d2-057221664af7 req-674de0bc-4751-4f70-b8bd-03ba81f43591 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:44.567275 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-03b8c200-a7c4-4cbc-b3e1-dd168138efb0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 200 len: 1363 microversion: 2.1 time: 0.152801 May 10 03:23:44.568105 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 349/709] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:44 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:44.580289 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-b21e5789-ff05-47ca-b6d2-057221664af7 req-674de0bc-4751-4f70-b8bd-03ba81f43591 service nova] Creating event network-changed:af3cf7e3-6eaf-4eb8-97db-23b35c82abb6 for instance 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 on hv-cinder-83009 May 10 03:23:44.585232 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-b21e5789-ff05-47ca-b6d2-057221664af7 req-674de0bc-4751-4f70-b8bd-03ba81f43591 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036542 May 10 03:23:44.585833 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 361/710] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:23:44.686710 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-65cd56b5-99fe-4baa-8c6f-8c7fdd68fa08 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:44.687408 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-65cd56b5-99fe-4baa-8c6f-8c7fdd68fa08 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:44.693567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-65cd56b5-99fe-4baa-8c6f-8c7fdd68fa08 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:44.694111 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-65cd56b5-99fe-4baa-8c6f-8c7fdd68fa08 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:44.694988 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-65cd56b5-99fe-4baa-8c6f-8c7fdd68fa08 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:44.695486 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-65cd56b5-99fe-4baa-8c6f-8c7fdd68fa08 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:44.827273 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-aefa5fed-f9b7-4635-9715-7c19771d6c05 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:44.828208 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-aefa5fed-f9b7-4635-9715-7c19771d6c05 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:44.829446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-65cd56b5-99fe-4baa-8c6f-8c7fdd68fa08 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:44.835451 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-aefa5fed-f9b7-4635-9715-7c19771d6c05 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:44.836166 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-aefa5fed-f9b7-4635-9715-7c19771d6c05 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:44.837218 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-aefa5fed-f9b7-4635-9715-7c19771d6c05 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:44.837705 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-65cd56b5-99fe-4baa-8c6f-8c7fdd68fa08 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1570 microversion: 2.1 time: 0.154733 May 10 03:23:44.837850 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-aefa5fed-f9b7-4635-9715-7c19771d6c05 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:44.838287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 350/711] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:44 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:44.968419 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-aefa5fed-f9b7-4635-9715-7c19771d6c05 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:44.976132 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-aefa5fed-f9b7-4635-9715-7c19771d6c05 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827" status: 200 len: 1365 microversion: 2.1 time: 0.154197 May 10 03:23:44.976712 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 362/712] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:44 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:45.584539 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-da31b011-1b63-4779-93cc-126869deb602 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:45.585136 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-da31b011-1b63-4779-93cc-126869deb602 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:45.591334 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-da31b011-1b63-4779-93cc-126869deb602 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:45.591784 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-da31b011-1b63-4779-93cc-126869deb602 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:45.592575 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-da31b011-1b63-4779-93cc-126869deb602 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:45.593005 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-da31b011-1b63-4779-93cc-126869deb602 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:45.715809 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-da31b011-1b63-4779-93cc-126869deb602 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:45.722945 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-da31b011-1b63-4779-93cc-126869deb602 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 200 len: 1549 microversion: 2.1 time: 0.142299 May 10 03:23:45.723512 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 351/713] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:45 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 1549 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:45.739176 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-cf10df05-b422-477b-b6c5-c51796e475ed tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:45.739679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-cf10df05-b422-477b-b6c5-c51796e475ed tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:45.745959 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-cf10df05-b422-477b-b6c5-c51796e475ed tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:45.746413 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-cf10df05-b422-477b-b6c5-c51796e475ed tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:45.747181 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-cf10df05-b422-477b-b6c5-c51796e475ed tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:45.747623 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-cf10df05-b422-477b-b6c5-c51796e475ed tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:45.826632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-cf10df05-b422-477b-b6c5-c51796e475ed tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091241 May 10 03:23:45.827221 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 363/714] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 10 03:23:45 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:45.854507 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-c474789b-7f7a-46e6-b38e-5843bf9304bf tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:45.855117 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-c474789b-7f7a-46e6-b38e-5843bf9304bf tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:45.861743 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c474789b-7f7a-46e6-b38e-5843bf9304bf tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:45.862309 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c474789b-7f7a-46e6-b38e-5843bf9304bf tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:45.863095 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c474789b-7f7a-46e6-b38e-5843bf9304bf tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:45.863532 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c474789b-7f7a-46e6-b38e-5843bf9304bf tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:45.992087 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-c474789b-7f7a-46e6-b38e-5843bf9304bf tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:45.993552 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-15ff9482-fa45-492d-90cf-1bd93cef7633 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:45.994425 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-15ff9482-fa45-492d-90cf-1bd93cef7633 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:45.999798 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-c474789b-7f7a-46e6-b38e-5843bf9304bf tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1570 microversion: 2.1 time: 0.149058 May 10 03:23:46.000570 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 352/715] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:45 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:46.010997 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-15ff9482-fa45-492d-90cf-1bd93cef7633 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:46.011537 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-15ff9482-fa45-492d-90cf-1bd93cef7633 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:46.012413 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-15ff9482-fa45-492d-90cf-1bd93cef7633 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:46.012956 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-15ff9482-fa45-492d-90cf-1bd93cef7633 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:46.141733 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-15ff9482-fa45-492d-90cf-1bd93cef7633 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:46.148988 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-15ff9482-fa45-492d-90cf-1bd93cef7633 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827" status: 200 len: 1365 microversion: 2.1 time: 0.159426 May 10 03:23:46.149555 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 364/716] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:45 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:47.016657 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-16166ce2-7a7d-43cf-9687-f9400543dadd tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:47.017275 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-16166ce2-7a7d-43cf-9687-f9400543dadd tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:47.023577 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-16166ce2-7a7d-43cf-9687-f9400543dadd tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:47.024051 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-16166ce2-7a7d-43cf-9687-f9400543dadd tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:47.025041 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-16166ce2-7a7d-43cf-9687-f9400543dadd tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:47.025482 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-16166ce2-7a7d-43cf-9687-f9400543dadd tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:47.164525 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-16166ce2-7a7d-43cf-9687-f9400543dadd tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:47.166298 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c6d6f69e-f04c-4fc9-874a-168e7287104d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:47.166910 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-c6d6f69e-f04c-4fc9-874a-168e7287104d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:47.175575 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-16166ce2-7a7d-43cf-9687-f9400543dadd tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1570 microversion: 2.1 time: 0.162368 May 10 03:23:47.175749 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c6d6f69e-f04c-4fc9-874a-168e7287104d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:47.176374 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c6d6f69e-f04c-4fc9-874a-168e7287104d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:47.177169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c6d6f69e-f04c-4fc9-874a-168e7287104d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:47.177994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c6d6f69e-f04c-4fc9-874a-168e7287104d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:47.189065 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 353/717] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:47 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:47.196249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-ff906959-d936-4a3b-bb16-d06ce3d51067 req-d9343452-59ee-4ba6-867d-0bc8d375d18f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9adf1a01-7c6f-4ad0-8b62-643d71caec83", "tag": "0f87c033-180b-41b9-bec8-9f6abee088d9"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:47.206822 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-ff906959-d936-4a3b-bb16-d06ce3d51067 req-d9343452-59ee-4ba6-867d-0bc8d375d18f service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:47.207608 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-ff906959-d936-4a3b-bb16-d06ce3d51067 req-d9343452-59ee-4ba6-867d-0bc8d375d18f service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:47.221193 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-ff906959-d936-4a3b-bb16-d06ce3d51067 req-d9343452-59ee-4ba6-867d-0bc8d375d18f service nova] Creating event network-changed:0f87c033-180b-41b9-bec8-9f6abee088d9 for instance 9adf1a01-7c6f-4ad0-8b62-643d71caec83 on hv-cinder-83009 May 10 03:23:47.227659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-ff906959-d936-4a3b-bb16-d06ce3d51067 req-d9343452-59ee-4ba6-867d-0bc8d375d18f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037214 May 10 03:23:47.229482 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 354/718] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:47.346634 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-c6d6f69e-f04c-4fc9-874a-168e7287104d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:47.355082 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-c6d6f69e-f04c-4fc9-874a-168e7287104d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827" status: 200 len: 1365 microversion: 2.1 time: 0.192656 May 10 03:23:47.364501 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 365/719] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:47 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:48.195598 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-9442ca15-2ce4-4b72-9f31-8b9272da0e4d tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:48.196337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-9442ca15-2ce4-4b72-9f31-8b9272da0e4d tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:48.203585 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9442ca15-2ce4-4b72-9f31-8b9272da0e4d tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:48.204073 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9442ca15-2ce4-4b72-9f31-8b9272da0e4d tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:48.204915 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9442ca15-2ce4-4b72-9f31-8b9272da0e4d tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:48.205519 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-9442ca15-2ce4-4b72-9f31-8b9272da0e4d tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:48.342047 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-9442ca15-2ce4-4b72-9f31-8b9272da0e4d tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:48.349619 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-9442ca15-2ce4-4b72-9f31-8b9272da0e4d tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1571 microversion: 2.1 time: 0.158588 May 10 03:23:48.350196 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 355/720] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:48 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:48.368381 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-42ec1b9d-9126-4175-b37b-92c3f521e637 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:48.369129 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-42ec1b9d-9126-4175-b37b-92c3f521e637 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:48.372252 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-6f067e7d-5ad6-47c7-acde-29e8ae58d4f7 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:48.372868 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-6f067e7d-5ad6-47c7-acde-29e8ae58d4f7 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:48.376776 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-42ec1b9d-9126-4175-b37b-92c3f521e637 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:48.377230 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-42ec1b9d-9126-4175-b37b-92c3f521e637 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:48.378258 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-42ec1b9d-9126-4175-b37b-92c3f521e637 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:48.378703 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-42ec1b9d-9126-4175-b37b-92c3f521e637 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:48.379293 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6f067e7d-5ad6-47c7-acde-29e8ae58d4f7 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:48.379967 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6f067e7d-5ad6-47c7-acde-29e8ae58d4f7 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:48.380666 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6f067e7d-5ad6-47c7-acde-29e8ae58d4f7 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:48.381351 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6f067e7d-5ad6-47c7-acde-29e8ae58d4f7 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:48.523281 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-6f067e7d-5ad6-47c7-acde-29e8ae58d4f7 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:48.541355 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-6f067e7d-5ad6-47c7-acde-29e8ae58d4f7 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827" status: 200 len: 1365 microversion: 2.1 time: 0.167404 May 10 03:23:48.542231 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 356/721] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:48 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:48.619453 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-42ec1b9d-9126-4175-b37b-92c3f521e637 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "POST /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8/action" status: 202 len: 0 microversion: 2.1 time: 0.254899 May 10 03:23:48.620255 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 366/722] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 03:23:48 2022] POST /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:23:48.628868 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-48f8fbf7-2c8a-4120-8ae5-5da788ee3024 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:48.629472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-48f8fbf7-2c8a-4120-8ae5-5da788ee3024 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:48.635569 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-48f8fbf7-2c8a-4120-8ae5-5da788ee3024 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:48.636031 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-48f8fbf7-2c8a-4120-8ae5-5da788ee3024 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:48.636805 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-48f8fbf7-2c8a-4120-8ae5-5da788ee3024 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:48.637242 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-48f8fbf7-2c8a-4120-8ae5-5da788ee3024 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:48.773304 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-48f8fbf7-2c8a-4120-8ae5-5da788ee3024 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:48.781295 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-48f8fbf7-2c8a-4120-8ae5-5da788ee3024 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1579 microversion: 2.1 time: 0.156257 May 10 03:23:48.781860 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 357/723] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:48 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:49.558814 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-712ba01f-f052-4c72-97ae-a0c1c1401608 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:49.559405 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-712ba01f-f052-4c72-97ae-a0c1c1401608 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:49.566782 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-712ba01f-f052-4c72-97ae-a0c1c1401608 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:49.567499 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-712ba01f-f052-4c72-97ae-a0c1c1401608 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:49.568126 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-712ba01f-f052-4c72-97ae-a0c1c1401608 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:49.568466 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-712ba01f-f052-4c72-97ae-a0c1c1401608 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:49.696872 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-712ba01f-f052-4c72-97ae-a0c1c1401608 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:49.704836 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-712ba01f-f052-4c72-97ae-a0c1c1401608 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827" status: 200 len: 1365 microversion: 2.1 time: 0.149942 May 10 03:23:49.705400 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 367/724] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:49 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:49.799021 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-7ac0b6f7-cf57-4046-82b6-eff3becf2a0c tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:49.799632 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-7ac0b6f7-cf57-4046-82b6-eff3becf2a0c tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:49.805947 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7ac0b6f7-cf57-4046-82b6-eff3becf2a0c tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:49.806395 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7ac0b6f7-cf57-4046-82b6-eff3becf2a0c tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:49.807166 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7ac0b6f7-cf57-4046-82b6-eff3becf2a0c tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:49.808165 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7ac0b6f7-cf57-4046-82b6-eff3becf2a0c tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:49.943015 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-7ac0b6f7-cf57-4046-82b6-eff3becf2a0c tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:49.951799 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-7ac0b6f7-cf57-4046-82b6-eff3becf2a0c tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1521 microversion: 2.1 time: 0.157071 May 10 03:23:49.952419 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 358/725] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:49 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:23:50.358439 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-8fdcc403-a809-4291-ba53-69a401c578bc req-73b03356-123e-409b-b1b5-de050e17d2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8", "name": "network-vif-unplugged", "status": "completed", "tag": "d0c4a220-cc8c-4389-8209-eac5e6740986"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:50.367490 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-8fdcc403-a809-4291-ba53-69a401c578bc req-73b03356-123e-409b-b1b5-de050e17d2f5 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:50.367951 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-8fdcc403-a809-4291-ba53-69a401c578bc req-73b03356-123e-409b-b1b5-de050e17d2f5 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:50.379124 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.compute.server_external_events [req-8fdcc403-a809-4291-ba53-69a401c578bc req-73b03356-123e-409b-b1b5-de050e17d2f5 service nova] Unable to find a host for instance 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8. Dropping event network-vif-unplugged {{(pid=117399) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 10 03:23:50.380051 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-8fdcc403-a809-4291-ba53-69a401c578bc req-73b03356-123e-409b-b1b5-de050e17d2f5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026043 May 10 03:23:50.380848 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 368/726] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 10 03:23:50.722401 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-e029308a-9816-40ad-a852-c64a6210cced tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:50.723371 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-e029308a-9816-40ad-a852-c64a6210cced tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:50.729432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e029308a-9816-40ad-a852-c64a6210cced tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:50.729966 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e029308a-9816-40ad-a852-c64a6210cced tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:50.730754 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e029308a-9816-40ad-a852-c64a6210cced tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:50.731195 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e029308a-9816-40ad-a852-c64a6210cced tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:50.860458 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-e029308a-9816-40ad-a852-c64a6210cced tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:50.867876 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-e029308a-9816-40ad-a852-c64a6210cced tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827" status: 200 len: 1365 microversion: 2.1 time: 0.149415 May 10 03:23:50.868556 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 359/727] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:50 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:50.969504 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-b6a625cd-378a-40d8-b8d3-219d7e391277 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:50.970113 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-b6a625cd-378a-40d8-b8d3-219d7e391277 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:50.976554 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b6a625cd-378a-40d8-b8d3-219d7e391277 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:50.976943 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b6a625cd-378a-40d8-b8d3-219d7e391277 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:50.977708 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b6a625cd-378a-40d8-b8d3-219d7e391277 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:50.978143 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b6a625cd-378a-40d8-b8d3-219d7e391277 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:51.110736 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-b6a625cd-378a-40d8-b8d3-219d7e391277 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:51.118089 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-b6a625cd-378a-40d8-b8d3-219d7e391277 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1577 microversion: 2.1 time: 0.153082 May 10 03:23:51.118656 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 369/728] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:50 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:51.888885 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-77d7e1d7-bed4-4708-8312-b53cf938a89d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:51.889494 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-77d7e1d7-bed4-4708-8312-b53cf938a89d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:51.895794 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-77d7e1d7-bed4-4708-8312-b53cf938a89d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:51.896282 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-77d7e1d7-bed4-4708-8312-b53cf938a89d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:51.897044 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-77d7e1d7-bed4-4708-8312-b53cf938a89d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:51.897479 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-77d7e1d7-bed4-4708-8312-b53cf938a89d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:52.023255 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-77d7e1d7-bed4-4708-8312-b53cf938a89d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:52.031021 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-77d7e1d7-bed4-4708-8312-b53cf938a89d tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827" status: 200 len: 1365 microversion: 2.1 time: 0.146141 May 10 03:23:52.031596 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 360/729] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:51 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:52.137144 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-5e24686d-5615-4f89-a5dc-870c94554a87 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:52.137753 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-5e24686d-5615-4f89-a5dc-870c94554a87 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:52.144671 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5e24686d-5615-4f89-a5dc-870c94554a87 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:52.145088 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5e24686d-5615-4f89-a5dc-870c94554a87 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:52.145836 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5e24686d-5615-4f89-a5dc-870c94554a87 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:52.146277 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5e24686d-5615-4f89-a5dc-870c94554a87 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:52.273890 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-5e24686d-5615-4f89-a5dc-870c94554a87 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:52.282212 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-5e24686d-5615-4f89-a5dc-870c94554a87 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1577 microversion: 2.1 time: 0.148836 May 10 03:23:52.282797 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 370/730] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:52 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:52.394971 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-42dd230d-1702-4771-b7e8-de4f06ee9ce2 req-37b69c25-e19d-41ac-b909-082a9fc1588b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87dd0c55-5fe5-4ea8-80f3-fd4af00ad827", "name": "network-vif-plugged", "status": "completed", "tag": "af3cf7e3-6eaf-4eb8-97db-23b35c82abb6"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:52.402682 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-42dd230d-1702-4771-b7e8-de4f06ee9ce2 req-37b69c25-e19d-41ac-b909-082a9fc1588b service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:52.403129 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-42dd230d-1702-4771-b7e8-de4f06ee9ce2 req-37b69c25-e19d-41ac-b909-082a9fc1588b service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:52.414175 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-42dd230d-1702-4771-b7e8-de4f06ee9ce2 req-37b69c25-e19d-41ac-b909-082a9fc1588b service nova] Creating event network-vif-plugged:af3cf7e3-6eaf-4eb8-97db-23b35c82abb6 for instance 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 on hv-cinder-83009 May 10 03:23:52.419057 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-42dd230d-1702-4771-b7e8-de4f06ee9ce2 req-37b69c25-e19d-41ac-b909-082a9fc1588b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027781 May 10 03:23:52.419922 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 361/731] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:53.048364 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-eb1d8999-74ec-49df-adcc-dbd5b9df4638 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:53.049002 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-eb1d8999-74ec-49df-adcc-dbd5b9df4638 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:53.054873 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-eb1d8999-74ec-49df-adcc-dbd5b9df4638 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:53.055332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-eb1d8999-74ec-49df-adcc-dbd5b9df4638 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:53.056139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-eb1d8999-74ec-49df-adcc-dbd5b9df4638 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:53.056600 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-eb1d8999-74ec-49df-adcc-dbd5b9df4638 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:53.188425 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-eb1d8999-74ec-49df-adcc-dbd5b9df4638 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:53.195838 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-eb1d8999-74ec-49df-adcc-dbd5b9df4638 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827" status: 200 len: 1365 microversion: 2.1 time: 0.152345 May 10 03:23:53.196446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 371/732] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:53 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:53.300551 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-bfea8a22-3687-445e-8f82-13f67ebbb817 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:53.301282 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-bfea8a22-3687-445e-8f82-13f67ebbb817 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:53.312192 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bfea8a22-3687-445e-8f82-13f67ebbb817 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:53.312661 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bfea8a22-3687-445e-8f82-13f67ebbb817 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:53.314689 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bfea8a22-3687-445e-8f82-13f67ebbb817 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:53.314808 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bfea8a22-3687-445e-8f82-13f67ebbb817 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:53.445781 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-bfea8a22-3687-445e-8f82-13f67ebbb817 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:53.454121 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-bfea8a22-3687-445e-8f82-13f67ebbb817 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1577 microversion: 2.1 time: 0.159178 May 10 03:23:53.454900 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 362/733] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:53 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:54.212778 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-f9090e41-5b4f-49fb-8672-306491f095c3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:54.213384 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-f9090e41-5b4f-49fb-8672-306491f095c3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:54.219605 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f9090e41-5b4f-49fb-8672-306491f095c3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:54.220074 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f9090e41-5b4f-49fb-8672-306491f095c3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:54.220846 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f9090e41-5b4f-49fb-8672-306491f095c3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:54.221279 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f9090e41-5b4f-49fb-8672-306491f095c3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:54.351240 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-f9090e41-5b4f-49fb-8672-306491f095c3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:54.361502 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-f9090e41-5b4f-49fb-8672-306491f095c3 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827" status: 200 len: 1365 microversion: 2.1 time: 0.149487 May 10 03:23:54.361502 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 372/734] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:54 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:54.470672 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-e1c496f5-662c-41be-b1a7-aa4b11afec1b tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:54.471379 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-e1c496f5-662c-41be-b1a7-aa4b11afec1b tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:54.477590 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e1c496f5-662c-41be-b1a7-aa4b11afec1b tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:54.478045 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e1c496f5-662c-41be-b1a7-aa4b11afec1b tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:54.478818 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e1c496f5-662c-41be-b1a7-aa4b11afec1b tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:54.479259 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e1c496f5-662c-41be-b1a7-aa4b11afec1b tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:54.608654 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-e1c496f5-662c-41be-b1a7-aa4b11afec1b tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:54.615982 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-e1c496f5-662c-41be-b1a7-aa4b11afec1b tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1577 microversion: 2.1 time: 0.149259 May 10 03:23:54.616575 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 363/735] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:54 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:55.374234 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-90360242-d82e-45ea-82d9-c582c2277c89 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:55.374900 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-90360242-d82e-45ea-82d9-c582c2277c89 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:55.381346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-90360242-d82e-45ea-82d9-c582c2277c89 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:55.381799 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-90360242-d82e-45ea-82d9-c582c2277c89 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:55.382568 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-90360242-d82e-45ea-82d9-c582c2277c89 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:55.383006 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-90360242-d82e-45ea-82d9-c582c2277c89 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:55.510707 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-90360242-d82e-45ea-82d9-c582c2277c89 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:55.518669 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-90360242-d82e-45ea-82d9-c582c2277c89 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827" status: 200 len: 1556 microversion: 2.1 time: 0.148295 May 10 03:23:55.519238 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 373/736] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:55 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 => generated 1556 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:55.537351 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a6c9d600-99a6-4d53-acdf-e003f8e25643 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:55.537923 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-a6c9d600-99a6-4d53-acdf-e003f8e25643 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:55.544421 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a6c9d600-99a6-4d53-acdf-e003f8e25643 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:55.545148 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a6c9d600-99a6-4d53-acdf-e003f8e25643 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:55.545958 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a6c9d600-99a6-4d53-acdf-e003f8e25643 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:55.546391 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a6c9d600-99a6-4d53-acdf-e003f8e25643 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:55.624947 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-a6c9d600-99a6-4d53-acdf-e003f8e25643 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091362 May 10 03:23:55.625490 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 364/737] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 10 03:23:55 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:23:55.633411 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-22e0bf7c-1fe7-4cfd-a18e-2c564da148d1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:55.634015 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-22e0bf7c-1fe7-4cfd-a18e-2c564da148d1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:55.640724 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-22e0bf7c-1fe7-4cfd-a18e-2c564da148d1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:55.641170 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-22e0bf7c-1fe7-4cfd-a18e-2c564da148d1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:55.641939 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-22e0bf7c-1fe7-4cfd-a18e-2c564da148d1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:55.642376 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-22e0bf7c-1fe7-4cfd-a18e-2c564da148d1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:56.138890 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-22e0bf7c-1fe7-4cfd-a18e-2c564da148d1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:56.146170 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-22e0bf7c-1fe7-4cfd-a18e-2c564da148d1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1577 microversion: 2.1 time: 0.516593 May 10 03:23:56.146739 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 374/738] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:55 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1577 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:56.355748 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-4cf23b6b-ccfc-4c3b-ab59-7789dbcf4af5 req-a3e8d7b3-95bd-4915-8a1a-1f240451d49f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8", "name": "network-vif-plugged", "status": "completed", "tag": "d0c4a220-cc8c-4389-8209-eac5e6740986"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:56.365258 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-4cf23b6b-ccfc-4c3b-ab59-7789dbcf4af5 req-a3e8d7b3-95bd-4915-8a1a-1f240451d49f service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:56.368719 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-4cf23b6b-ccfc-4c3b-ab59-7789dbcf4af5 req-a3e8d7b3-95bd-4915-8a1a-1f240451d49f service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:56.376566 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-4cf23b6b-ccfc-4c3b-ab59-7789dbcf4af5 req-a3e8d7b3-95bd-4915-8a1a-1f240451d49f service nova] Creating event network-vif-plugged:d0c4a220-cc8c-4389-8209-eac5e6740986 for instance 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 on hv-cinder-83009 May 10 03:23:56.381552 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-4cf23b6b-ccfc-4c3b-ab59-7789dbcf4af5 req-a3e8d7b3-95bd-4915-8a1a-1f240451d49f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029949 May 10 03:23:56.382507 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 365/739] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:56.981794 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-f9a973ac-3b70-4ba5-81c7-fa8ccfab0fd4 req-7c6f0ab3-b778-4d3f-8359-88a742a6cb87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87dd0c55-5fe5-4ea8-80f3-fd4af00ad827", "tag": "af3cf7e3-6eaf-4eb8-97db-23b35c82abb6"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:23:56.990015 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-f9a973ac-3b70-4ba5-81c7-fa8ccfab0fd4 req-7c6f0ab3-b778-4d3f-8359-88a742a6cb87 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:56.990868 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-f9a973ac-3b70-4ba5-81c7-fa8ccfab0fd4 req-7c6f0ab3-b778-4d3f-8359-88a742a6cb87 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:57.001041 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-f9a973ac-3b70-4ba5-81c7-fa8ccfab0fd4 req-7c6f0ab3-b778-4d3f-8359-88a742a6cb87 service nova] Creating event network-changed:af3cf7e3-6eaf-4eb8-97db-23b35c82abb6 for instance 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 on hv-cinder-83009 May 10 03:23:57.006196 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-f9a973ac-3b70-4ba5-81c7-fa8ccfab0fd4 req-7c6f0ab3-b778-4d3f-8359-88a742a6cb87 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028025 May 10 03:23:57.006779 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 375/740] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:23:57.163661 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-492df333-2c04-46b9-bac5-9d1221e91fa7 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:57.164303 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-492df333-2c04-46b9-bac5-9d1221e91fa7 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:57.171706 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-492df333-2c04-46b9-bac5-9d1221e91fa7 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:57.171706 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-492df333-2c04-46b9-bac5-9d1221e91fa7 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:57.172628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-492df333-2c04-46b9-bac5-9d1221e91fa7 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:57.172628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-492df333-2c04-46b9-bac5-9d1221e91fa7 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:57.360424 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-492df333-2c04-46b9-bac5-9d1221e91fa7 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:57.367920 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-492df333-2c04-46b9-bac5-9d1221e91fa7 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1577 microversion: 2.1 time: 0.208951 May 10 03:23:57.368689 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 366/741] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:57 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1577 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:58.386563 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ed2913c2-aa19-473c-ac74-592ad249bc2e tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:58.387259 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ed2913c2-aa19-473c-ac74-592ad249bc2e tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:58.393981 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ed2913c2-aa19-473c-ac74-592ad249bc2e tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:58.394434 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ed2913c2-aa19-473c-ac74-592ad249bc2e tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:58.395197 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ed2913c2-aa19-473c-ac74-592ad249bc2e tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:58.395636 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ed2913c2-aa19-473c-ac74-592ad249bc2e tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:58.578135 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ed2913c2-aa19-473c-ac74-592ad249bc2e tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:58.585507 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ed2913c2-aa19-473c-ac74-592ad249bc2e tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1577 microversion: 2.1 time: 0.203601 May 10 03:23:58.586074 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 376/742] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:58 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:23:59.602334 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a6aa616b-8755-4ae5-93ba-31a191aacd53 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:23:59.602943 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-a6aa616b-8755-4ae5-93ba-31a191aacd53 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:23:59.609884 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a6aa616b-8755-4ae5-93ba-31a191aacd53 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:59.610337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a6aa616b-8755-4ae5-93ba-31a191aacd53 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:59.611125 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a6aa616b-8755-4ae5-93ba-31a191aacd53 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:23:59.611557 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a6aa616b-8755-4ae5-93ba-31a191aacd53 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:23:59.736915 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-a6aa616b-8755-4ae5-93ba-31a191aacd53 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:23:59.744365 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-a6aa616b-8755-4ae5-93ba-31a191aacd53 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1564 microversion: 2.1 time: 0.145803 May 10 03:23:59.744933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 367/743] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:23:59 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1564 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:24:05.277062 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-989a47fd-d89a-4d47-91ff-b64979bb9721 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1006105752"}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:24:05.277584 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-989a47fd-d89a-4d47-91ff-b64979bb9721 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:05.284566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-989a47fd-d89a-4d47-91ff-b64979bb9721 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:05.285020 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-989a47fd-d89a-4d47-91ff-b64979bb9721 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:05.285786 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-989a47fd-d89a-4d47-91ff-b64979bb9721 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:05.286223 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-989a47fd-d89a-4d47-91ff-b64979bb9721 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:05.409002 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.network.security_group_api [None req-989a47fd-d89a-4d47-91ff-b64979bb9721 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Removing security group 76e6e958-f119-42af-b5d9-3ca1306a1bc1 from port 28d80747-ff10-4f4c-93bb-2b2d343c9e8e May 10 03:24:05.804764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-989a47fd-d89a-4d47-91ff-b64979bb9721 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "POST /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b/action" status: 202 len: 0 microversion: 2.1 time: 0.531151 May 10 03:24:05.809535 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 377/744] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 10 03:24:05 2022] POST /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:24:05.811257 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-f4e3adaa-3101-4866-a437-791f9f9ada87 req-2b6fd801-1adf-4c9b-a06d-b8dc4556b9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eedf1629-9431-4b77-92e3-253377280b0b", "tag": "28d80747-ff10-4f4c-93bb-2b2d343c9e8e"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:24:05.823631 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-f4e3adaa-3101-4866-a437-791f9f9ada87 req-2b6fd801-1adf-4c9b-a06d-b8dc4556b9f4 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:05.824106 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-f4e3adaa-3101-4866-a437-791f9f9ada87 req-2b6fd801-1adf-4c9b-a06d-b8dc4556b9f4 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:05.842833 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-f4e3adaa-3101-4866-a437-791f9f9ada87 req-2b6fd801-1adf-4c9b-a06d-b8dc4556b9f4 service nova] Creating event network-changed:28d80747-ff10-4f4c-93bb-2b2d343c9e8e for instance eedf1629-9431-4b77-92e3-253377280b0b on hv-cinder-83009 May 10 03:24:05.849671 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-f4e3adaa-3101-4866-a437-791f9f9ada87 req-2b6fd801-1adf-4c9b-a06d-b8dc4556b9f4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042065 May 10 03:24:05.850972 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 368/745] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:07.273413 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-8fcaa213-91c5-4cac-87e6-789cb9fbf764 req-e96bb279-7865-4280-8b94-e336574e7d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eedf1629-9431-4b77-92e3-253377280b0b", "tag": "28d80747-ff10-4f4c-93bb-2b2d343c9e8e"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:24:07.279436 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e4dbe240-8eeb-4b59-814d-31136fc806b7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:07.279923 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-e4dbe240-8eeb-4b59-814d-31136fc806b7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:07.286849 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e4dbe240-8eeb-4b59-814d-31136fc806b7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:07.287301 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e4dbe240-8eeb-4b59-814d-31136fc806b7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:07.287544 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-8fcaa213-91c5-4cac-87e6-789cb9fbf764 req-e96bb279-7865-4280-8b94-e336574e7d96 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:07.287986 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-8fcaa213-91c5-4cac-87e6-789cb9fbf764 req-e96bb279-7865-4280-8b94-e336574e7d96 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:07.288122 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e4dbe240-8eeb-4b59-814d-31136fc806b7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:07.288510 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e4dbe240-8eeb-4b59-814d-31136fc806b7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:07.300310 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-8fcaa213-91c5-4cac-87e6-789cb9fbf764 req-e96bb279-7865-4280-8b94-e336574e7d96 service nova] Creating event network-changed:28d80747-ff10-4f4c-93bb-2b2d343c9e8e for instance eedf1629-9431-4b77-92e3-253377280b0b on hv-cinder-83009 May 10 03:24:07.305759 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-8fcaa213-91c5-4cac-87e6-789cb9fbf764 req-e96bb279-7865-4280-8b94-e336574e7d96 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036227 May 10 03:24:07.306433 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 369/746] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:07.386191 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.objects.instance [None req-e4dbe240-8eeb-4b59-814d-31136fc806b7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lazy-loading 'services' on Instance uuid eedf1629-9431-4b77-92e3-253377280b0b {{(pid=117399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:24:07.594281 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-e4dbe240-8eeb-4b59-814d-31136fc806b7 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "DELETE /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b/os-volume_attachments/d452dc7d-855e-4eb0-9b09-2343afca56b7" status: 202 len: 0 microversion: 2.1 time: 0.326977 May 10 03:24:07.605820 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-d094d4de-8352-47f8-817e-ab3719dbac78 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:07.606942 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-d094d4de-8352-47f8-817e-ab3719dbac78 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:07.611147 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 378/747] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 10 03:24:07 2022] DELETE /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b/os-volume_attachments/d452dc7d-855e-4eb0-9b09-2343afca56b7 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:24:07.615376 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d094d4de-8352-47f8-817e-ab3719dbac78 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:07.615919 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d094d4de-8352-47f8-817e-ab3719dbac78 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:07.616810 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d094d4de-8352-47f8-817e-ab3719dbac78 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:07.617329 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d094d4de-8352-47f8-817e-ab3719dbac78 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:07.648187 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-d094d4de-8352-47f8-817e-ab3719dbac78 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048105 May 10 03:24:07.652337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 370/748] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 03:24:07 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:08.603963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-729b42c8-915b-468a-83be-36a6b4753f54 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:08.604559 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-729b42c8-915b-468a-83be-36a6b4753f54 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:08.611584 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-729b42c8-915b-468a-83be-36a6b4753f54 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:08.612055 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-729b42c8-915b-468a-83be-36a6b4753f54 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:08.612850 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-729b42c8-915b-468a-83be-36a6b4753f54 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:08.613283 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-729b42c8-915b-468a-83be-36a6b4753f54 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:08.663715 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-c98765c3-acdf-4d74-a54c-c4f17157fe4e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:08.664670 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-c98765c3-acdf-4d74-a54c-c4f17157fe4e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:08.671014 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c98765c3-acdf-4d74-a54c-c4f17157fe4e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:08.671467 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c98765c3-acdf-4d74-a54c-c4f17157fe4e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:08.672784 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c98765c3-acdf-4d74-a54c-c4f17157fe4e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:08.673223 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c98765c3-acdf-4d74-a54c-c4f17157fe4e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:08.701477 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.objects.instance [None req-729b42c8-915b-468a-83be-36a6b4753f54 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lazy-loading 'services' on Instance uuid a010d765-8dc4-44a9-922a-feabd172565b {{(pid=117399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:24:08.703355 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-c98765c3-acdf-4d74-a54c-c4f17157fe4e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046128 May 10 03:24:08.703931 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 371/749] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 03:24:08 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:24:08.714843 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-d91f8bf6-bed8-4224-a493-db71488b02f4 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:08.715409 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-d91f8bf6-bed8-4224-a493-db71488b02f4 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:08.721832 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d91f8bf6-bed8-4224-a493-db71488b02f4 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:08.722336 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d91f8bf6-bed8-4224-a493-db71488b02f4 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:08.723156 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d91f8bf6-bed8-4224-a493-db71488b02f4 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:08.723798 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d91f8bf6-bed8-4224-a493-db71488b02f4 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:08.803952 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-d91f8bf6-bed8-4224-a493-db71488b02f4 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] HTTP exception thrown: Instance eedf1629-9431-4b77-92e3-253377280b0b is not attached to volume d452dc7d-855e-4eb0-9b09-2343afca56b7 May 10 03:24:08.813956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-d91f8bf6-bed8-4224-a493-db71488b02f4 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Request method failure captured: May 10 03:24:08.813956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: DELETE /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b/os-volume_attachments/d452dc7d-855e-4eb0-9b09-2343afca56b7 HTTP/1.1 May 10 03:24:08.813956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:24:08.813956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:24:08.813956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:24:08.813956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:24:08.813956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:24:08.813956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:24:08.813956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:24:08.813956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:24:08.813956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedonTTcMmAEMvxStX4_4nVgDwKzsGADrTNy34KCrcHABMt9cyCBJ7E_DzkhSWbO_jgKst7sENoFUPmzieP0U7tCSm6b_1H0IH_G8eXr0vsD-5URvwYsvurBYOug_O4Z8Xp0XmcN_bxCGsRn_po7ww543rRQHCLIK8067cheXoOpp3ao May 10 03:24:08.813956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:24:08.813956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:24:08.813956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:24:08.813956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:24:08.813956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:24:08.813956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:24:08.813956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: c5f50448e3cc4533a5c70bb766559548 May 10 03:24:08.813956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-TestMinimumBasicScenario-251487798 May 10 03:24:08.813956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:24:08.813956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:24:08.815572 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c5f50448e3cc4533a5c70bb766559548", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c5f50448e3cc4533a5c70bb766559548"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c5f50448e3cc4533a5c70bb766559548"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c5f50448e3cc4533a5c70bb766559548"}]}] May 10 03:24:08.815572 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-TestMinimumBasicScenario-251487798 May 10 03:24:08.815572 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: c5f50448e3cc4533a5c70bb766559548 May 10 03:24:08.815572 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-TestMinimumBasicScenario-251487798 May 10 03:24:08.815572 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-TestMinimumBasicScenario-251487798-project May 10 03:24:08.815572 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:24:08.815572 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:24:08.815572 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: b978be2083814d1f825af17697b6613c May 10 03:24:08.815572 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-TestMinimumBasicScenario-251487798-project May 10 03:24:08.815572 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:24:08.815572 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Instance eedf1629-9431-4b77-92e3-253377280b0b is not attached to volume d452dc7d-855e-4eb0-9b09-2343afca56b7 May 10 03:24:08.816580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'server_id': 'eedf1629-9431-4b77-92e3-253377280b0b', 'id': 'd452dc7d-855e-4eb0-9b09-2343afca56b7'} May 10 03:24:08.816580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:24:08.816580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:24:08.816580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 10 03:24:08.816580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 10 03:24:08.816580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 03:24:08.816580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 03:24:08.816580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 10 03:24:08.816580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 10 03:24:08.816580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d452dc7d-855e-4eb0-9b09-2343afca56b7. May 10 03:24:08.816580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:08.816580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:24:08.816580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:08.816580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:24:08.816580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:24:08.816580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:24:08.816580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:24:08.816580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:24:08.816580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:24:08.818136 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:24:08.818136 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 10 03:24:08.818136 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 03:24:08.818136 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eedf1629-9431-4b77-92e3-253377280b0b is not attached to volume d452dc7d-855e-4eb0-9b09-2343afca56b7 May 10 03:24:08.818136 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:08.818136 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:24:08.818136 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:08.818136 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:24:08.818136 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:24:08.818136 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:24:08.818136 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:24:08.818136 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:24:08.818136 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eedf1629-9431-4b77-92e3-253377280b0b is not attached to volume d452dc7d-855e-4eb0-9b09-2343afca56b7 May 10 03:24:08.818136 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:08.818136 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-d91f8bf6-bed8-4224-a493-db71488b02f4 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Returning 404 to user: Instance eedf1629-9431-4b77-92e3-253377280b0b is not attached to volume d452dc7d-855e-4eb0-9b09-2343afca56b7 {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:24:08.819355 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-d91f8bf6-bed8-4224-a493-db71488b02f4 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "DELETE /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b/os-volume_attachments/d452dc7d-855e-4eb0-9b09-2343afca56b7" status: 404 len: 154 microversion: 2.1 time: 0.104625 May 10 03:24:08.819355 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 372/750] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 10 03:24:08 2022] DELETE /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b/os-volume_attachments/d452dc7d-855e-4eb0-9b09-2343afca56b7 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 03:24:08.987928 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-729b42c8-915b-468a-83be-36a6b4753f54 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b/os-volume_attachments/f97ca27e-7fda-4c11-a14a-1ac14e69bac9" status: 202 len: 0 microversion: 2.1 time: 0.388196 May 10 03:24:08.988571 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 379/751] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 10 03:24:08 2022] DELETE /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b/os-volume_attachments/f97ca27e-7fda-4c11-a14a-1ac14e69bac9 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:24:08.999834 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-6c3a985c-9240-4803-a68c-05bda2b94511 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:09.001435 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-6c3a985c-9240-4803-a68c-05bda2b94511 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:09.007547 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6c3a985c-9240-4803-a68c-05bda2b94511 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:09.007992 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6c3a985c-9240-4803-a68c-05bda2b94511 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:09.008975 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6c3a985c-9240-4803-a68c-05bda2b94511 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:09.009565 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6c3a985c-9240-4803-a68c-05bda2b94511 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:09.041545 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-6c3a985c-9240-4803-a68c-05bda2b94511 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048090 May 10 03:24:09.042108 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 373/752] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 03:24:08 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:24:10.054220 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-93ba7c7a-7a8e-4011-99ec-2d2ae3c4faf5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:10.055343 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-93ba7c7a-7a8e-4011-99ec-2d2ae3c4faf5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:10.061676 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-93ba7c7a-7a8e-4011-99ec-2d2ae3c4faf5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:10.062128 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-93ba7c7a-7a8e-4011-99ec-2d2ae3c4faf5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:10.062924 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-93ba7c7a-7a8e-4011-99ec-2d2ae3c4faf5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:10.063349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-93ba7c7a-7a8e-4011-99ec-2d2ae3c4faf5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:10.077441 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-61f7e45b-d6d5-4a8c-b961-fa2524cb363a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:10.077974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-61f7e45b-d6d5-4a8c-b961-fa2524cb363a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:10.084819 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-61f7e45b-d6d5-4a8c-b961-fa2524cb363a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:10.085277 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-61f7e45b-d6d5-4a8c-b961-fa2524cb363a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:10.086056 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-61f7e45b-d6d5-4a8c-b961-fa2524cb363a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:10.086496 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-61f7e45b-d6d5-4a8c-b961-fa2524cb363a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:10.094625 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-93ba7c7a-7a8e-4011-99ec-2d2ae3c4faf5 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045077 May 10 03:24:10.095205 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 380/753] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 03:24:10 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:24:10.111565 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-61f7e45b-d6d5-4a8c-b961-fa2524cb363a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Going to try to terminate instance {{(pid=117400) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:24:10.172393 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-904c5f2f-681c-410a-a3ab-d0ce5db106bd tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:10.173687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-904c5f2f-681c-410a-a3ab-d0ce5db106bd tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:10.179436 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-904c5f2f-681c-410a-a3ab-d0ce5db106bd tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:10.179980 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-904c5f2f-681c-410a-a3ab-d0ce5db106bd tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:10.180779 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-904c5f2f-681c-410a-a3ab-d0ce5db106bd tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:10.181219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-904c5f2f-681c-410a-a3ab-d0ce5db106bd tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:10.207230 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-904c5f2f-681c-410a-a3ab-d0ce5db106bd tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Going to try to terminate instance {{(pid=117399) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:24:10.404987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-61f7e45b-d6d5-4a8c-b961-fa2524cb363a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "DELETE /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 204 len: 0 microversion: 2.1 time: 0.331177 May 10 03:24:10.405588 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 374/754] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:24:10 2022] DELETE /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 03:24:10.413670 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-7a52b3f3-984c-4bb3-9d3d-14e4b3549703 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:10.414368 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-7a52b3f3-984c-4bb3-9d3d-14e4b3549703 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:10.420021 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7a52b3f3-984c-4bb3-9d3d-14e4b3549703 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:10.420752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7a52b3f3-984c-4bb3-9d3d-14e4b3549703 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:10.421515 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7a52b3f3-984c-4bb3-9d3d-14e4b3549703 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:10.421961 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7a52b3f3-984c-4bb3-9d3d-14e4b3549703 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:10.513357 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-904c5f2f-681c-410a-a3ab-d0ce5db106bd tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 204 len: 0 microversion: 2.1 time: 0.344798 May 10 03:24:10.514042 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 381/755] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:24:10 2022] DELETE /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 03:24:10.522390 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a99e7491-dedd-4704-a09d-44c8029c55a1 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:10.523268 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-a99e7491-dedd-4704-a09d-44c8029c55a1 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:10.529283 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a99e7491-dedd-4704-a09d-44c8029c55a1 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:10.534622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a99e7491-dedd-4704-a09d-44c8029c55a1 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:10.534622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a99e7491-dedd-4704-a09d-44c8029c55a1 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:10.534622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a99e7491-dedd-4704-a09d-44c8029c55a1 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:10.554615 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-7a52b3f3-984c-4bb3-9d3d-14e4b3549703 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:10.562139 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-7a52b3f3-984c-4bb3-9d3d-14e4b3549703 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1554 microversion: 2.1 time: 0.152359 May 10 03:24:10.563042 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 375/756] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:10 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:24:10.665713 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-a99e7491-dedd-4704-a09d-44c8029c55a1 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:10.674020 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-a99e7491-dedd-4704-a09d-44c8029c55a1 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1690 microversion: 2.1 time: 0.154947 May 10 03:24:10.674598 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 382/757] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:10 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:24:11.580313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-e3b5d24a-6d07-4462-bf81-8f9447dc570c tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:11.580963 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-e3b5d24a-6d07-4462-bf81-8f9447dc570c tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:11.587339 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e3b5d24a-6d07-4462-bf81-8f9447dc570c tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:11.587788 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e3b5d24a-6d07-4462-bf81-8f9447dc570c tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:11.588591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e3b5d24a-6d07-4462-bf81-8f9447dc570c tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:11.589034 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e3b5d24a-6d07-4462-bf81-8f9447dc570c tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:11.691360 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-5c1a3930-d8bb-4613-852d-8568950fb10a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:11.692122 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-5c1a3930-d8bb-4613-852d-8568950fb10a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:11.698680 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5c1a3930-d8bb-4613-852d-8568950fb10a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:11.699202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5c1a3930-d8bb-4613-852d-8568950fb10a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:11.699989 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5c1a3930-d8bb-4613-852d-8568950fb10a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:11.700449 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5c1a3930-d8bb-4613-852d-8568950fb10a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:11.720992 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-e3b5d24a-6d07-4462-bf81-8f9447dc570c tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:11.728393 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-e3b5d24a-6d07-4462-bf81-8f9447dc570c tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1554 microversion: 2.1 time: 0.152469 May 10 03:24:11.728963 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 376/758] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:11 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:24:11.825008 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-5c1a3930-d8bb-4613-852d-8568950fb10a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:11.832380 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-5c1a3930-d8bb-4613-852d-8568950fb10a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1690 microversion: 2.1 time: 0.145419 May 10 03:24:11.832945 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 383/759] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:11 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1690 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:24:12.745108 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-1e8c19fe-7019-49ed-9f12-6908fe19f40e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:12.745726 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-1e8c19fe-7019-49ed-9f12-6908fe19f40e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:12.752030 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1e8c19fe-7019-49ed-9f12-6908fe19f40e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:12.752488 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1e8c19fe-7019-49ed-9f12-6908fe19f40e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:12.753249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1e8c19fe-7019-49ed-9f12-6908fe19f40e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:12.753684 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1e8c19fe-7019-49ed-9f12-6908fe19f40e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:12.791118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-4cd43e1e-dc18-400a-ab01-c81722eb3ddb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:12.791661 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-4cd43e1e-dc18-400a-ab01-c81722eb3ddb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:12.798923 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4cd43e1e-dc18-400a-ab01-c81722eb3ddb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:12.799378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4cd43e1e-dc18-400a-ab01-c81722eb3ddb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:12.800286 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4cd43e1e-dc18-400a-ab01-c81722eb3ddb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:12.800731 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4cd43e1e-dc18-400a-ab01-c81722eb3ddb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:12.823749 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-4cd43e1e-dc18-400a-ab01-c81722eb3ddb tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e/ips" status: 200 len: 152 microversion: 2.20 time: 0.036381 May 10 03:24:12.824360 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 384/760] 10.222.0.65 () {60 vars in 1288 bytes} [Tue May 10 03:24:12 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 03:24:12.849589 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-7cf16fff-d141-4742-ab6f-a824c85407b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:12.850205 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-7cf16fff-d141-4742-ab6f-a824c85407b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:12.856754 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7cf16fff-d141-4742-ab6f-a824c85407b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:12.857480 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7cf16fff-d141-4742-ab6f-a824c85407b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:12.858477 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7cf16fff-d141-4742-ab6f-a824c85407b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:12.859230 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7cf16fff-d141-4742-ab6f-a824c85407b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:12.885265 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1e8c19fe-7019-49ed-9f12-6908fe19f40e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:12.893007 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-1e8c19fe-7019-49ed-9f12-6908fe19f40e tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1554 microversion: 2.1 time: 0.151688 May 10 03:24:12.893589 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 377/761] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:12 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:24:12.989213 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-7cf16fff-d141-4742-ab6f-a824c85407b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:12.996685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-7cf16fff-d141-4742-ab6f-a824c85407b4 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1690 microversion: 2.1 time: 0.150794 May 10 03:24:12.997243 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 385/762] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:12 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:24:13.910600 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-49f4c1a4-4e5d-425c-8d6f-621140353878 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:13.911216 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-49f4c1a4-4e5d-425c-8d6f-621140353878 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:13.917547 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-49f4c1a4-4e5d-425c-8d6f-621140353878 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:13.921225 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-49f4c1a4-4e5d-425c-8d6f-621140353878 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:13.921225 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-49f4c1a4-4e5d-425c-8d6f-621140353878 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:13.921225 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-49f4c1a4-4e5d-425c-8d6f-621140353878 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:14.013674 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-92a774b2-ac32-42d0-8c5e-5cdf6c30fa77 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:14.014300 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-92a774b2-ac32-42d0-8c5e-5cdf6c30fa77 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:14.021327 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-92a774b2-ac32-42d0-8c5e-5cdf6c30fa77 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:14.021791 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-92a774b2-ac32-42d0-8c5e-5cdf6c30fa77 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:14.022566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-92a774b2-ac32-42d0-8c5e-5cdf6c30fa77 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:14.023015 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-92a774b2-ac32-42d0-8c5e-5cdf6c30fa77 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:14.050739 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-49f4c1a4-4e5d-425c-8d6f-621140353878 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:14.058400 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-49f4c1a4-4e5d-425c-8d6f-621140353878 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1554 microversion: 2.1 time: 0.152179 May 10 03:24:14.058983 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 378/763] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:13 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:24:14.148854 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-92a774b2-ac32-42d0-8c5e-5cdf6c30fa77 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:14.156242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-92a774b2-ac32-42d0-8c5e-5cdf6c30fa77 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1690 microversion: 2.1 time: 0.146463 May 10 03:24:14.156823 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 386/764] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:14 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1690 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:24:15.075116 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-306b48bd-5660-400c-b4e1-c98d37ba57a2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:15.075728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-306b48bd-5660-400c-b4e1-c98d37ba57a2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:15.082795 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-306b48bd-5660-400c-b4e1-c98d37ba57a2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:15.083243 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-306b48bd-5660-400c-b4e1-c98d37ba57a2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:15.084037 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-306b48bd-5660-400c-b4e1-c98d37ba57a2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:15.084478 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-306b48bd-5660-400c-b4e1-c98d37ba57a2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:15.174810 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ff29be51-79e5-4ea7-8b21-e75b0078e3a8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:15.175411 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ff29be51-79e5-4ea7-8b21-e75b0078e3a8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:15.181632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ff29be51-79e5-4ea7-8b21-e75b0078e3a8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:15.182073 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ff29be51-79e5-4ea7-8b21-e75b0078e3a8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:15.182833 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ff29be51-79e5-4ea7-8b21-e75b0078e3a8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:15.183263 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ff29be51-79e5-4ea7-8b21-e75b0078e3a8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:15.212221 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-306b48bd-5660-400c-b4e1-c98d37ba57a2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:15.219701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-306b48bd-5660-400c-b4e1-c98d37ba57a2 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1554 microversion: 2.1 time: 0.148355 May 10 03:24:15.220299 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 379/765] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:15 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:24:15.310684 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ff29be51-79e5-4ea7-8b21-e75b0078e3a8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:15.318072 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ff29be51-79e5-4ea7-8b21-e75b0078e3a8 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1690 microversion: 2.1 time: 0.147861 May 10 03:24:15.318630 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 387/766] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:15 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1690 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:24:15.755917 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-d6b7a5b4-73c6-4037-aacd-b34f786b512d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:24:15.756432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-d6b7a5b4-73c6-4037-aacd-b34f786b512d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:15.762306 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d6b7a5b4-73c6-4037-aacd-b34f786b512d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:15.762752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d6b7a5b4-73c6-4037-aacd-b34f786b512d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:15.763512 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d6b7a5b4-73c6-4037-aacd-b34f786b512d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:15.763944 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d6b7a5b4-73c6-4037-aacd-b34f786b512d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:15.785836 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.objects.instance [None req-d6b7a5b4-73c6-4037-aacd-b34f786b512d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lazy-loading 'flavor' on Instance uuid d490231e-628d-467d-a571-2538c3646f1e {{(pid=117400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:24:16.236492 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-6112756b-5a0c-4e9e-adf4-cce62cf9d42a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:16.237208 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-6112756b-5a0c-4e9e-adf4-cce62cf9d42a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:16.243647 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6112756b-5a0c-4e9e-adf4-cce62cf9d42a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:16.244121 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6112756b-5a0c-4e9e-adf4-cce62cf9d42a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:16.244897 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6112756b-5a0c-4e9e-adf4-cce62cf9d42a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:16.245334 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6112756b-5a0c-4e9e-adf4-cce62cf9d42a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:16.253778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-d6b7a5b4-73c6-4037-aacd-b34f786b512d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "POST /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e/action" status: 202 len: 0 microversion: 2.20 time: 0.502183 May 10 03:24:16.254691 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 380/767] 10.222.0.65 () {62 vars in 1318 bytes} [Tue May 10 03:24:15 2022] POST /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 03:24:16.266974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-b38933d6-1fd4-4010-93ff-ca76c76e7bb8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:16.268895 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-b38933d6-1fd4-4010-93ff-ca76c76e7bb8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:16.276341 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b38933d6-1fd4-4010-93ff-ca76c76e7bb8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:16.276795 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b38933d6-1fd4-4010-93ff-ca76c76e7bb8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:16.277572 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b38933d6-1fd4-4010-93ff-ca76c76e7bb8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:16.278073 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b38933d6-1fd4-4010-93ff-ca76c76e7bb8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:16.476922 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-6112756b-5a0c-4e9e-adf4-cce62cf9d42a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:16.483436 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-b38933d6-1fd4-4010-93ff-ca76c76e7bb8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:16.485129 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-6112756b-5a0c-4e9e-adf4-cce62cf9d42a tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1554 microversion: 2.1 time: 0.252344 May 10 03:24:16.494705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 388/768] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:16 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1554 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:24:16.494705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-2b565f00-16e2-4df9-83fc-c6869af2d06a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:16.494705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-2b565f00-16e2-4df9-83fc-c6869af2d06a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:16.495242 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-b38933d6-1fd4-4010-93ff-ca76c76e7bb8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:16.495242 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-b38933d6-1fd4-4010-93ff-ca76c76e7bb8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:16.496626 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-b38933d6-1fd4-4010-93ff-ca76c76e7bb8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1724 microversion: 2.20 time: 0.236836 May 10 03:24:16.497190 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 381/769] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:16 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:24:16.504676 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2b565f00-16e2-4df9-83fc-c6869af2d06a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:16.505334 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2b565f00-16e2-4df9-83fc-c6869af2d06a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:16.506189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2b565f00-16e2-4df9-83fc-c6869af2d06a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:16.506700 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2b565f00-16e2-4df9-83fc-c6869af2d06a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:16.526735 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-679cbf3c-22b1-46cb-be1f-a07f1779298c req-0a852a7e-6988-4b13-98dc-79a11ae5199a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eedf1629-9431-4b77-92e3-253377280b0b", "name": "network-vif-unplugged", "status": "completed", "tag": "28d80747-ff10-4f4c-93bb-2b2d343c9e8e"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:24:16.537105 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-679cbf3c-22b1-46cb-be1f-a07f1779298c req-0a852a7e-6988-4b13-98dc-79a11ae5199a service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:16.537105 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-679cbf3c-22b1-46cb-be1f-a07f1779298c req-0a852a7e-6988-4b13-98dc-79a11ae5199a service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:16.547374 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-679cbf3c-22b1-46cb-be1f-a07f1779298c req-0a852a7e-6988-4b13-98dc-79a11ae5199a service nova] Creating event network-vif-unplugged:28d80747-ff10-4f4c-93bb-2b2d343c9e8e for instance eedf1629-9431-4b77-92e3-253377280b0b on hv-cinder-83009 May 10 03:24:16.552492 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-679cbf3c-22b1-46cb-be1f-a07f1779298c req-0a852a7e-6988-4b13-98dc-79a11ae5199a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030120 May 10 03:24:16.553297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 382/770] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:24:16.652488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-2b565f00-16e2-4df9-83fc-c6869af2d06a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:16.665327 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-2b565f00-16e2-4df9-83fc-c6869af2d06a tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1690 microversion: 2.1 time: 0.177320 May 10 03:24:16.665908 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 389/771] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:16 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1690 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:24:17.503632 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-73c23c1d-826b-4392-961a-fbb2e2ab2ea8 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:17.504353 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-73c23c1d-826b-4392-961a-fbb2e2ab2ea8 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:17.511654 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-73c23c1d-826b-4392-961a-fbb2e2ab2ea8 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:17.512371 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-73c23c1d-826b-4392-961a-fbb2e2ab2ea8 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:17.513330 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-73c23c1d-826b-4392-961a-fbb2e2ab2ea8 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:17.516102 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-73c23c1d-826b-4392-961a-fbb2e2ab2ea8 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:17.516279 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-240b0eac-5fa9-4f72-83c4-d2c6a3bc08e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:17.516279 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-240b0eac-5fa9-4f72-83c4-d2c6a3bc08e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:17.523896 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-240b0eac-5fa9-4f72-83c4-d2c6a3bc08e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:17.525218 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-240b0eac-5fa9-4f72-83c4-d2c6a3bc08e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:17.526147 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-240b0eac-5fa9-4f72-83c4-d2c6a3bc08e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:17.526660 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-240b0eac-5fa9-4f72-83c4-d2c6a3bc08e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:17.594040 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-73c23c1d-826b-4392-961a-fbb2e2ab2ea8 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b978be2083814d1f825af17697b6613c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f50448e3cc4533a5c70bb766559548', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:17.602013 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-73c23c1d-826b-4392-961a-fbb2e2ab2ea8 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 200 len: 1512 microversion: 2.1 time: 0.103695 May 10 03:24:17.602590 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 383/772] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:17 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 1512 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:24:17.616470 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-baea2eff-7c79-4903-96ff-43ef590fec14 req-be8bf02c-9692-451f-badd-ffa2d95b4a18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eedf1629-9431-4b77-92e3-253377280b0b", "name": "network-vif-deleted", "tag": "28d80747-ff10-4f4c-93bb-2b2d343c9e8e"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:24:17.624190 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-baea2eff-7c79-4903-96ff-43ef590fec14 req-be8bf02c-9692-451f-badd-ffa2d95b4a18 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:17.624634 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-baea2eff-7c79-4903-96ff-43ef590fec14 req-be8bf02c-9692-451f-badd-ffa2d95b4a18 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:17.636492 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-baea2eff-7c79-4903-96ff-43ef590fec14 req-be8bf02c-9692-451f-badd-ffa2d95b4a18 service nova] Creating event network-vif-deleted:28d80747-ff10-4f4c-93bb-2b2d343c9e8e for instance eedf1629-9431-4b77-92e3-253377280b0b on hv-cinder-83009 May 10 03:24:17.642032 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-baea2eff-7c79-4903-96ff-43ef590fec14 req-be8bf02c-9692-451f-badd-ffa2d95b4a18 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029119 May 10 03:24:17.644676 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 384/773] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:17.683547 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-ca6e790e-0a4a-4dc7-a053-9ef97f31595e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:17.684440 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-ca6e790e-0a4a-4dc7-a053-9ef97f31595e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:17.691538 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ca6e790e-0a4a-4dc7-a053-9ef97f31595e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:17.694619 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ca6e790e-0a4a-4dc7-a053-9ef97f31595e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:17.694619 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ca6e790e-0a4a-4dc7-a053-9ef97f31595e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:17.694619 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ca6e790e-0a4a-4dc7-a053-9ef97f31595e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:17.721311 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-240b0eac-5fa9-4f72-83c4-d2c6a3bc08e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:17.722015 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-240b0eac-5fa9-4f72-83c4-d2c6a3bc08e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:17.723640 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-240b0eac-5fa9-4f72-83c4-d2c6a3bc08e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:17.724952 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-240b0eac-5fa9-4f72-83c4-d2c6a3bc08e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1724 microversion: 2.20 time: 0.214136 May 10 03:24:17.725586 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 390/774] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:17 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:24:17.835219 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ca6e790e-0a4a-4dc7-a053-9ef97f31595e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:17.842768 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-ca6e790e-0a4a-4dc7-a053-9ef97f31595e tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1690 microversion: 2.1 time: 0.163659 May 10 03:24:17.846449 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 385/775] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:17 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:24:18.624544 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a34b13dc-34ec-4795-b16a-cb444ffa7ee3 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:18.625771 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-a34b13dc-34ec-4795-b16a-cb444ffa7ee3 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] [instance: eedf1629-9431-4b77-92e3-253377280b0b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:18.633044 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a34b13dc-34ec-4795-b16a-cb444ffa7ee3 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:18.633500 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a34b13dc-34ec-4795-b16a-cb444ffa7ee3 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:18.634314 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a34b13dc-34ec-4795-b16a-cb444ffa7ee3 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:18.634751 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a34b13dc-34ec-4795-b16a-cb444ffa7ee3 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:18.649367 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-a34b13dc-34ec-4795-b16a-cb444ffa7ee3 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] HTTP exception thrown: Instance eedf1629-9431-4b77-92e3-253377280b0b could not be found. May 10 03:24:18.651013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a34b13dc-34ec-4795-b16a-cb444ffa7ee3 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Request method failure captured: May 10 03:24:18.651013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b HTTP/1.1 May 10 03:24:18.651013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:24:18.651013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:24:18.651013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:24:18.651013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:24:18.651013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:24:18.651013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:24:18.651013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:24:18.651013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:24:18.651013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedonTTcMmAEMvxStX4_4nVgDwKzsGADrTNy34KCrcHABMt9cyCBJ7E_DzkhSWbO_jgKst7sENoFUPmzieP0U7tCSm6b_1H0IH_G8eXr0vsD-5URvwYsvurBYOug_O4Z8Xp0XmcN_bxCGsRn_po7ww543rRQHCLIK8067cheXoOpp3ao May 10 03:24:18.651013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:24:18.651013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:24:18.651013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:24:18.651013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:24:18.651013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:24:18.651013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:24:18.651013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: c5f50448e3cc4533a5c70bb766559548 May 10 03:24:18.651013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-TestMinimumBasicScenario-251487798 May 10 03:24:18.651013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:24:18.651013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:24:18.654486 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c5f50448e3cc4533a5c70bb766559548", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c5f50448e3cc4533a5c70bb766559548"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c5f50448e3cc4533a5c70bb766559548"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c5f50448e3cc4533a5c70bb766559548"}]}] May 10 03:24:18.654486 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-TestMinimumBasicScenario-251487798 May 10 03:24:18.654486 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: c5f50448e3cc4533a5c70bb766559548 May 10 03:24:18.654486 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-TestMinimumBasicScenario-251487798 May 10 03:24:18.654486 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-TestMinimumBasicScenario-251487798-project May 10 03:24:18.654486 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:24:18.654486 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:24:18.654486 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: b978be2083814d1f825af17697b6613c May 10 03:24:18.654486 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-TestMinimumBasicScenario-251487798-project May 10 03:24:18.654486 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: > May 10 03:24:18.654486 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Instance eedf1629-9431-4b77-92e3-253377280b0b could not be found. May 10 03:24:18.654486 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': 'eedf1629-9431-4b77-92e3-253377280b0b'} May 10 03:24:18.655446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:24:18.655446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:24:18.655446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:24:18.655446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:24:18.655446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:24:18.655446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:24:18.655446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:24:18.655446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:24:18.655446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:24:18.655446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:24:18.655446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eedf1629-9431-4b77-92e3-253377280b0b could not be found. May 10 03:24:18.655446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:24:18.655446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:24:18.655446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:24:18.655446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:24:18.655446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:24:18.655446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:24:18.655446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:24:18.655446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:24:18.655446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:24:18.657346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:24:18.657346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:24:18.657346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:24:18.657346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:24:18.657346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:24:18.657346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:24:18.657346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:24:18.657346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eedf1629-9431-4b77-92e3-253377280b0b could not be found. May 10 03:24:18.657346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:24:18.657346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:24:18.657346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:24:18.657346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:24:18.657346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:24:18.657346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:24:18.657346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:24:18.657346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:24:18.657346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eedf1629-9431-4b77-92e3-253377280b0b could not be found. May 10 03:24:18.657346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:24:18.659764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a34b13dc-34ec-4795-b16a-cb444ffa7ee3 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Returning 404 to user: Instance eedf1629-9431-4b77-92e3-253377280b0b could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:24:18.659764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-a34b13dc-34ec-4795-b16a-cb444ffa7ee3 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b" status: 404 len: 111 microversion: 2.1 time: 0.032154 May 10 03:24:18.659764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 391/776] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:18 2022] GET /compute/v2.1/servers/eedf1629-9431-4b77-92e3-253377280b0b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:24:18.661419 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-9e817b26-513e-43cf-a3b2-b469901bd356 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] Calling method '.version_select at 0x7f6a5d0bae50>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:18.745010 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-865dbdb3-4282-40d7-b35d-2e8c70867b4f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:18.745550 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-865dbdb3-4282-40d7-b35d-2e8c70867b4f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:18.753857 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-865dbdb3-4282-40d7-b35d-2e8c70867b4f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:18.754530 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-865dbdb3-4282-40d7-b35d-2e8c70867b4f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:18.755020 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-9e817b26-513e-43cf-a3b2-b469901bd356 tempest-TestMinimumBasicScenario-251487798 tempest-TestMinimumBasicScenario-251487798-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2038567233" status: 202 len: 0 microversion: 2.1 time: 0.097409 May 10 03:24:18.755480 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-865dbdb3-4282-40d7-b35d-2e8c70867b4f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:18.755927 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-865dbdb3-4282-40d7-b35d-2e8c70867b4f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:18.756520 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 386/777] 10.222.0.65 () {58 vars in 1271 bytes} [Tue May 10 03:24:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2038567233 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:24:18.860568 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-76e0eaaa-1f5b-4407-bf2f-c1ff93310384 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:18.861230 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-76e0eaaa-1f5b-4407-bf2f-c1ff93310384 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:18.868149 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-76e0eaaa-1f5b-4407-bf2f-c1ff93310384 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:18.868921 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-76e0eaaa-1f5b-4407-bf2f-c1ff93310384 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:18.869960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-76e0eaaa-1f5b-4407-bf2f-c1ff93310384 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:18.870618 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-76e0eaaa-1f5b-4407-bf2f-c1ff93310384 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:18.904621 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-76e0eaaa-1f5b-4407-bf2f-c1ff93310384 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:18.905228 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-76e0eaaa-1f5b-4407-bf2f-c1ff93310384 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:18.906482 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-865dbdb3-4282-40d7-b35d-2e8c70867b4f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:18.916680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.objects.instance [None req-76e0eaaa-1f5b-4407-bf2f-c1ff93310384 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lazy-loading 'fault' on Instance uuid a010d765-8dc4-44a9-922a-feabd172565b {{(pid=117400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:24:18.926391 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-865dbdb3-4282-40d7-b35d-2e8c70867b4f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:18.929002 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-865dbdb3-4282-40d7-b35d-2e8c70867b4f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:18.930425 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-865dbdb3-4282-40d7-b35d-2e8c70867b4f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1724 microversion: 2.20 time: 0.189473 May 10 03:24:18.930984 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 392/778] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:18 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:24:18.961363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-76e0eaaa-1f5b-4407-bf2f-c1ff93310384 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:18.968972 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-76e0eaaa-1f5b-4407-bf2f-c1ff93310384 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 200 len: 1336 microversion: 2.1 time: 0.112156 May 10 03:24:18.969587 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 387/779] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:18 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 1336 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:24:19.663737 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-61a52389-09be-4ef5-ac10-4f29a058c012 req-5132c0a3-052c-4ec8-b708-80908be0c033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a010d765-8dc4-44a9-922a-feabd172565b", "name": "network-vif-deleted", "tag": "3d3f8b1a-cfaf-4bd6-babb-ab9bd3c7b319"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:24:19.672947 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-61a52389-09be-4ef5-ac10-4f29a058c012 req-5132c0a3-052c-4ec8-b708-80908be0c033 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:19.678679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-61a52389-09be-4ef5-ac10-4f29a058c012 req-5132c0a3-052c-4ec8-b708-80908be0c033 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:19.684455 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-61a52389-09be-4ef5-ac10-4f29a058c012 req-5132c0a3-052c-4ec8-b708-80908be0c033 service nova] Creating event network-vif-deleted:3d3f8b1a-cfaf-4bd6-babb-ab9bd3c7b319 for instance a010d765-8dc4-44a9-922a-feabd172565b on hv-cinder-83009 May 10 03:24:19.689102 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-61a52389-09be-4ef5-ac10-4f29a058c012 req-5132c0a3-052c-4ec8-b708-80908be0c033 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029131 May 10 03:24:19.690187 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 393/780] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:19.948435 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-024ef3f5-2744-4692-8986-2d4b8344021c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:19.948959 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-024ef3f5-2744-4692-8986-2d4b8344021c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:19.955997 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-024ef3f5-2744-4692-8986-2d4b8344021c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:19.956469 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-024ef3f5-2744-4692-8986-2d4b8344021c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:19.957295 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-024ef3f5-2744-4692-8986-2d4b8344021c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:19.957726 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-024ef3f5-2744-4692-8986-2d4b8344021c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:19.987294 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-2377e484-4e0f-4636-b7cc-a1896547a110 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:19.988693 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-2377e484-4e0f-4636-b7cc-a1896547a110 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: a010d765-8dc4-44a9-922a-feabd172565b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:19.995167 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2377e484-4e0f-4636-b7cc-a1896547a110 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:19.997963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2377e484-4e0f-4636-b7cc-a1896547a110 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:19.997963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2377e484-4e0f-4636-b7cc-a1896547a110 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:19.997963 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2377e484-4e0f-4636-b7cc-a1896547a110 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:20.010824 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-2377e484-4e0f-4636-b7cc-a1896547a110 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] HTTP exception thrown: Instance a010d765-8dc4-44a9-922a-feabd172565b could not be found. May 10 03:24:20.012526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-2377e484-4e0f-4636-b7cc-a1896547a110 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Request method failure captured: May 10 03:24:20.012526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b HTTP/1.1 May 10 03:24:20.012526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:24:20.012526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:24:20.012526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:24:20.012526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:24:20.012526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:24:20.012526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:24:20.012526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:24:20.012526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:24:20.012526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedm4YBo_VeiW-S1UxjlvvKNx7u6jWbPbvvm0pYOm5amQBwu7q0C7Rd8nGSaIclBMXEqqaxCizBVj7NePFJ1eCV8CTM1okztCGz5tsrL80ntHdSO2lpXeHCYcWrqg_AqJQDp6ALaVfEt1ayCvEgCMFkenfpQm-YCKlUpXTGJxCi7gX6Y May 10 03:24:20.012526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:24:20.012526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:24:20.012526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:24:20.012526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:24:20.012526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:24:20.012526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:24:20.012526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: d8e319a149db44fb8bb71f3066c82956 May 10 03:24:20.012526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1946563297 May 10 03:24:20.012526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:24:20.012526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:24:20.014065 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d8e319a149db44fb8bb71f3066c82956", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8e319a149db44fb8bb71f3066c82956"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8e319a149db44fb8bb71f3066c82956"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d8e319a149db44fb8bb71f3066c82956"}]}] May 10 03:24:20.014065 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1946563297 May 10 03:24:20.014065 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: d8e319a149db44fb8bb71f3066c82956 May 10 03:24:20.014065 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1946563297 May 10 03:24:20.014065 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-ServerRescueNegativeTestJSON-1946563297-project May 10 03:24:20.014065 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:24:20.014065 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:24:20.014065 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: e309fb66a98b407d8b7533207e6a6dfc May 10 03:24:20.014065 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1946563297-project May 10 03:24:20.014065 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: > May 10 03:24:20.014065 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Instance a010d765-8dc4-44a9-922a-feabd172565b could not be found. May 10 03:24:20.014065 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': 'a010d765-8dc4-44a9-922a-feabd172565b'} May 10 03:24:20.014999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:24:20.014999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:24:20.014999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:24:20.014999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:24:20.014999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:24:20.014999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:24:20.014999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:24:20.014999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:24:20.014999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:24:20.014999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:24:20.014999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a010d765-8dc4-44a9-922a-feabd172565b could not be found. May 10 03:24:20.014999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:24:20.014999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:24:20.014999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:24:20.014999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:24:20.014999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:24:20.014999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:24:20.014999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:24:20.014999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:24:20.014999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:24:20.016566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:24:20.016566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:24:20.016566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:24:20.016566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:24:20.016566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:24:20.016566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:24:20.016566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:24:20.016566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a010d765-8dc4-44a9-922a-feabd172565b could not be found. May 10 03:24:20.016566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:24:20.016566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:24:20.016566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:24:20.016566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:24:20.016566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:24:20.016566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:24:20.016566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:24:20.016566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:24:20.016566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a010d765-8dc4-44a9-922a-feabd172565b could not be found. May 10 03:24:20.016566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:24:20.018572 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-2377e484-4e0f-4636-b7cc-a1896547a110 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Returning 404 to user: Instance a010d765-8dc4-44a9-922a-feabd172565b could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:24:20.018572 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-2377e484-4e0f-4636-b7cc-a1896547a110 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b" status: 404 len: 111 microversion: 2.1 time: 0.030937 May 10 03:24:20.018572 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 394/781] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:19 2022] GET /compute/v2.1/servers/a010d765-8dc4-44a9-922a-feabd172565b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 03:24:20.023359 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-9fee51c0-fc80-4c5a-8d0e-a944a92ea734 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '.version_select at 0x7f6a5da521f0>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:20.082058 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-9fee51c0-fc80-4c5a-8d0e-a944a92ea734 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1349442515" status: 202 len: 0 microversion: 2.1 time: 0.062681 May 10 03:24:20.086337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 395/782] 10.222.0.65 () {58 vars in 1220 bytes} [Tue May 10 03:24:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1349442515 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 03:24:20.108430 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-024ef3f5-2744-4692-8986-2d4b8344021c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:20.116873 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-024ef3f5-2744-4692-8986-2d4b8344021c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:20.118533 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-024ef3f5-2744-4692-8986-2d4b8344021c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:20.120081 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-024ef3f5-2744-4692-8986-2d4b8344021c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1724 microversion: 2.20 time: 0.175572 May 10 03:24:20.127643 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 388/783] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:19 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:21.138658 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-b16f66a6-5282-48cb-b611-a9998e8c548d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:21.139937 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-b16f66a6-5282-48cb-b611-a9998e8c548d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:21.147667 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b16f66a6-5282-48cb-b611-a9998e8c548d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:21.148934 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b16f66a6-5282-48cb-b611-a9998e8c548d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:21.148934 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b16f66a6-5282-48cb-b611-a9998e8c548d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:21.149409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b16f66a6-5282-48cb-b611-a9998e8c548d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:21.292656 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-b16f66a6-5282-48cb-b611-a9998e8c548d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:21.306255 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-b16f66a6-5282-48cb-b611-a9998e8c548d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:21.308782 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-b16f66a6-5282-48cb-b611-a9998e8c548d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:21.309605 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-b16f66a6-5282-48cb-b611-a9998e8c548d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1724 microversion: 2.20 time: 0.175224 May 10 03:24:21.310167 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 396/784] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:21 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:22.342958 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-3b50cfeb-86ff-4146-90fd-89d9168f4a10 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:22.342958 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-3b50cfeb-86ff-4146-90fd-89d9168f4a10 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:22.342958 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3b50cfeb-86ff-4146-90fd-89d9168f4a10 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:22.342958 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3b50cfeb-86ff-4146-90fd-89d9168f4a10 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:22.343951 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3b50cfeb-86ff-4146-90fd-89d9168f4a10 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:22.343951 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3b50cfeb-86ff-4146-90fd-89d9168f4a10 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:22.480433 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-3b50cfeb-86ff-4146-90fd-89d9168f4a10 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:22.492532 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-3b50cfeb-86ff-4146-90fd-89d9168f4a10 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:22.494036 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-3b50cfeb-86ff-4146-90fd-89d9168f4a10 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:22.495332 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-3b50cfeb-86ff-4146-90fd-89d9168f4a10 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1724 microversion: 2.20 time: 0.170220 May 10 03:24:22.495983 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 389/785] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:22 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:23.366697 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-3a95e69a-d6a7-47ba-8bde-7cc1c72cf593 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:23.368137 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-3a95e69a-d6a7-47ba-8bde-7cc1c72cf593 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:23.375946 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3a95e69a-d6a7-47ba-8bde-7cc1c72cf593 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:23.376435 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3a95e69a-d6a7-47ba-8bde-7cc1c72cf593 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:23.377992 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3a95e69a-d6a7-47ba-8bde-7cc1c72cf593 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:23.378734 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3a95e69a-d6a7-47ba-8bde-7cc1c72cf593 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:23.415359 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-3a95e69a-d6a7-47ba-8bde-7cc1c72cf593 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Going to try to terminate instance {{(pid=117399) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:24:23.513820 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-6c66fa55-455a-44e9-97c5-00d3d93d2ee0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:23.520305 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-6c66fa55-455a-44e9-97c5-00d3d93d2ee0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:23.527428 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6c66fa55-455a-44e9-97c5-00d3d93d2ee0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:23.528119 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6c66fa55-455a-44e9-97c5-00d3d93d2ee0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:23.529055 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6c66fa55-455a-44e9-97c5-00d3d93d2ee0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:23.529483 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6c66fa55-455a-44e9-97c5-00d3d93d2ee0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:23.749975 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-3a95e69a-d6a7-47ba-8bde-7cc1c72cf593 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "DELETE /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 204 len: 0 microversion: 2.1 time: 0.391492 May 10 03:24:23.751935 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 397/786] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:24:23 2022] DELETE /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:24:23.761533 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-6862cf42-6602-4ed6-8bc6-e54be32abc4d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:23.763347 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-6862cf42-6602-4ed6-8bc6-e54be32abc4d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:23.775169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6862cf42-6602-4ed6-8bc6-e54be32abc4d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:23.779501 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6862cf42-6602-4ed6-8bc6-e54be32abc4d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:23.780703 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6862cf42-6602-4ed6-8bc6-e54be32abc4d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:23.782050 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6862cf42-6602-4ed6-8bc6-e54be32abc4d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:23.995006 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-6c66fa55-455a-44e9-97c5-00d3d93d2ee0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:24.003241 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-6c66fa55-455a-44e9-97c5-00d3d93d2ee0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:24.004781 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-6c66fa55-455a-44e9-97c5-00d3d93d2ee0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:24.014076 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-6c66fa55-455a-44e9-97c5-00d3d93d2ee0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1724 microversion: 2.20 time: 0.496172 May 10 03:24:24.014076 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 390/787] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:23 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1724 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:24:24.018364 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-6862cf42-6602-4ed6-8bc6-e54be32abc4d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:24.025845 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-6862cf42-6602-4ed6-8bc6-e54be32abc4d tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1507 microversion: 2.1 time: 0.269467 May 10 03:24:24.026414 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 398/788] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:23 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1507 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:24:25.024313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-7671c2dd-16ee-4f55-bc1b-d0be9ae97b53 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:25.024926 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-7671c2dd-16ee-4f55-bc1b-d0be9ae97b53 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:25.031725 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7671c2dd-16ee-4f55-bc1b-d0be9ae97b53 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:25.032347 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7671c2dd-16ee-4f55-bc1b-d0be9ae97b53 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:25.033539 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7671c2dd-16ee-4f55-bc1b-d0be9ae97b53 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:25.033775 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7671c2dd-16ee-4f55-bc1b-d0be9ae97b53 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:25.042569 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-b561933b-ca76-40fc-9b46-fb13143a324c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:25.043175 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-b561933b-ca76-40fc-9b46-fb13143a324c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:25.049802 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b561933b-ca76-40fc-9b46-fb13143a324c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:25.050248 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b561933b-ca76-40fc-9b46-fb13143a324c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:25.051003 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b561933b-ca76-40fc-9b46-fb13143a324c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:25.051438 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b561933b-ca76-40fc-9b46-fb13143a324c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:25.359813 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-7671c2dd-16ee-4f55-bc1b-d0be9ae97b53 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:25.368209 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-7671c2dd-16ee-4f55-bc1b-d0be9ae97b53 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:25.368911 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-b561933b-ca76-40fc-9b46-fb13143a324c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:25.369696 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-7671c2dd-16ee-4f55-bc1b-d0be9ae97b53 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:25.370890 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-7671c2dd-16ee-4f55-bc1b-d0be9ae97b53 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1724 microversion: 2.20 time: 0.350545 May 10 03:24:25.371640 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 391/789] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:25 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1724 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:25.376670 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-b561933b-ca76-40fc-9b46-fb13143a324c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1507 microversion: 2.1 time: 0.337970 May 10 03:24:25.378135 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 399/790] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:25 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1507 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:24:26.395728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-5958c7cb-e625-4ac8-9437-7bc25d9e155e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:26.397832 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-5958c7cb-e625-4ac8-9437-7bc25d9e155e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:26.399021 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-525b4bb0-1258-48ef-b54e-a90f1884f315 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:26.399659 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-525b4bb0-1258-48ef-b54e-a90f1884f315 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:26.408846 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5958c7cb-e625-4ac8-9437-7bc25d9e155e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:26.409629 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5958c7cb-e625-4ac8-9437-7bc25d9e155e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:26.410648 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5958c7cb-e625-4ac8-9437-7bc25d9e155e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:26.410791 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-525b4bb0-1258-48ef-b54e-a90f1884f315 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:26.411666 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5958c7cb-e625-4ac8-9437-7bc25d9e155e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:26.412226 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-525b4bb0-1258-48ef-b54e-a90f1884f315 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:26.413153 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-525b4bb0-1258-48ef-b54e-a90f1884f315 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:26.414430 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-525b4bb0-1258-48ef-b54e-a90f1884f315 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:27.022410 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-525b4bb0-1258-48ef-b54e-a90f1884f315 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:27.023949 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5958c7cb-e625-4ac8-9437-7bc25d9e155e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:27.030704 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-525b4bb0-1258-48ef-b54e-a90f1884f315 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 200 len: 1507 microversion: 2.1 time: 0.636510 May 10 03:24:27.031554 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 400/791] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:26 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 1507 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:24:27.037043 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-8f03b526-c82f-4be9-85f5-45cf3c55bee2 req-38fc0651-ee2b-45b3-b281-2381947b83c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "544c3a1e-c28b-47ab-bf79-33a141cf9beb", "name": "network-vif-deleted", "tag": "f0cb85c5-3fec-4e59-9a36-21921ca34926"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:24:27.043151 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5958c7cb-e625-4ac8-9437-7bc25d9e155e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:27.044702 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5958c7cb-e625-4ac8-9437-7bc25d9e155e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:27.046172 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-5958c7cb-e625-4ac8-9437-7bc25d9e155e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1724 microversion: 2.20 time: 0.654720 May 10 03:24:27.047057 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 392/792] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:26 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1724 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:27.047192 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-8f03b526-c82f-4be9-85f5-45cf3c55bee2 req-38fc0651-ee2b-45b3-b281-2381947b83c2 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:27.047858 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-8f03b526-c82f-4be9-85f5-45cf3c55bee2 req-38fc0651-ee2b-45b3-b281-2381947b83c2 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:27.070956 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-8f03b526-c82f-4be9-85f5-45cf3c55bee2 req-38fc0651-ee2b-45b3-b281-2381947b83c2 service nova] Creating event network-vif-deleted:f0cb85c5-3fec-4e59-9a36-21921ca34926 for instance 544c3a1e-c28b-47ab-bf79-33a141cf9beb on hv-cinder-83009 May 10 03:24:27.082002 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-8f03b526-c82f-4be9-85f5-45cf3c55bee2 req-38fc0651-ee2b-45b3-b281-2381947b83c2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045468 May 10 03:24:27.083076 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 401/793] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:28.048655 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-500949e5-0f09-4861-9dff-edfe755f43f0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:28.049370 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-500949e5-0f09-4861-9dff-edfe755f43f0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: 544c3a1e-c28b-47ab-bf79-33a141cf9beb] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:28.056381 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-500949e5-0f09-4861-9dff-edfe755f43f0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:28.056797 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-500949e5-0f09-4861-9dff-edfe755f43f0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:28.057866 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-500949e5-0f09-4861-9dff-edfe755f43f0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:28.058009 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-500949e5-0f09-4861-9dff-edfe755f43f0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:28.067016 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-4cb9ffca-2fcd-4e5d-a224-e63501b7e00e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:28.068246 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-4cb9ffca-2fcd-4e5d-a224-e63501b7e00e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:28.073957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-500949e5-0f09-4861-9dff-edfe755f43f0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] HTTP exception thrown: Instance 544c3a1e-c28b-47ab-bf79-33a141cf9beb could not be found. May 10 03:24:28.073957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-500949e5-0f09-4861-9dff-edfe755f43f0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Request method failure captured: May 10 03:24:28.073957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb HTTP/1.1 May 10 03:24:28.073957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:24:28.073957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:24:28.073957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:24:28.073957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:24:28.073957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:24:28.073957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:24:28.073957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:24:28.073957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:24:28.073957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedm4YBo_VeiW-S1UxjlvvKNx7u6jWbPbvvm0pYOm5amQBwu7q0C7Rd8nGSaIclBMXEqqaxCizBVj7NePFJ1eCV8CTM1okztCGz5tsrL80ntHdSO2lpXeHCYcWrqg_AqJQDp6ALaVfEt1ayCvEgCMFkenfpQm-YCKlUpXTGJxCi7gX6Y May 10 03:24:28.073957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:24:28.073957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:24:28.073957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:24:28.073957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:24:28.073957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:24:28.073957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:24:28.073957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: d8e319a149db44fb8bb71f3066c82956 May 10 03:24:28.073957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1946563297 May 10 03:24:28.073957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:24:28.073957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:24:28.075762 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d8e319a149db44fb8bb71f3066c82956", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8e319a149db44fb8bb71f3066c82956"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8e319a149db44fb8bb71f3066c82956"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d8e319a149db44fb8bb71f3066c82956"}]}] May 10 03:24:28.075762 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1946563297 May 10 03:24:28.075762 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: d8e319a149db44fb8bb71f3066c82956 May 10 03:24:28.075762 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1946563297 May 10 03:24:28.075762 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-ServerRescueNegativeTestJSON-1946563297-project May 10 03:24:28.075762 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:24:28.075762 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:24:28.075762 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: e309fb66a98b407d8b7533207e6a6dfc May 10 03:24:28.075762 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1946563297-project May 10 03:24:28.075762 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:24:28.075762 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Instance 544c3a1e-c28b-47ab-bf79-33a141cf9beb could not be found. May 10 03:24:28.075762 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'id': '544c3a1e-c28b-47ab-bf79-33a141cf9beb'} May 10 03:24:28.076516 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:24:28.076516 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:24:28.076516 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:24:28.076516 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:24:28.076516 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:24:28.076516 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:24:28.076516 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:24:28.076516 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:24:28.076516 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:24:28.076516 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:24:28.076516 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 544c3a1e-c28b-47ab-bf79-33a141cf9beb could not be found. May 10 03:24:28.076516 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:28.076516 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:24:28.076516 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:28.076516 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:24:28.076516 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:24:28.076516 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:24:28.076516 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:24:28.076516 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:24:28.076516 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:24:28.077653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:24:28.077653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:24:28.077653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:24:28.077653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:24:28.077653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:24:28.077653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:24:28.077653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:24:28.077653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 544c3a1e-c28b-47ab-bf79-33a141cf9beb could not be found. May 10 03:24:28.077653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:28.077653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:24:28.077653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:28.077653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:24:28.077653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:24:28.077653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:24:28.077653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:24:28.077653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:24:28.077653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 544c3a1e-c28b-47ab-bf79-33a141cf9beb could not be found. May 10 03:24:28.077653 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:28.078684 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-500949e5-0f09-4861-9dff-edfe755f43f0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Returning 404 to user: Instance 544c3a1e-c28b-47ab-bf79-33a141cf9beb could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:24:28.078684 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-500949e5-0f09-4861-9dff-edfe755f43f0 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb" status: 404 len: 111 microversion: 2.1 time: 0.030817 May 10 03:24:28.078684 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 393/794] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:28 2022] GET /compute/v2.1/servers/544c3a1e-c28b-47ab-bf79-33a141cf9beb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:24:28.083241 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4cb9ffca-2fcd-4e5d-a224-e63501b7e00e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:28.083879 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4cb9ffca-2fcd-4e5d-a224-e63501b7e00e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:28.084864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4cb9ffca-2fcd-4e5d-a224-e63501b7e00e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:28.085310 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4cb9ffca-2fcd-4e5d-a224-e63501b7e00e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:28.086015 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-f9db8758-71a1-413a-9fe1-210cfe3a0871 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:28.086586 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-f9db8758-71a1-413a-9fe1-210cfe3a0871 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:28.092501 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f9db8758-71a1-413a-9fe1-210cfe3a0871 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:28.092942 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f9db8758-71a1-413a-9fe1-210cfe3a0871 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:28.094036 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f9db8758-71a1-413a-9fe1-210cfe3a0871 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:28.094474 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f9db8758-71a1-413a-9fe1-210cfe3a0871 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:28.119822 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-f9db8758-71a1-413a-9fe1-210cfe3a0871 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Going to try to terminate instance {{(pid=117400) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:24:28.226538 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-4cb9ffca-2fcd-4e5d-a224-e63501b7e00e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:28.234349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-4cb9ffca-2fcd-4e5d-a224-e63501b7e00e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:28.235835 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-4cb9ffca-2fcd-4e5d-a224-e63501b7e00e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:28.237089 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-4cb9ffca-2fcd-4e5d-a224-e63501b7e00e tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1724 microversion: 2.20 time: 0.175796 May 10 03:24:28.237879 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 402/795] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:28 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:24:28.370802 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-f9db8758-71a1-413a-9fe1-210cfe3a0871 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 204 len: 0 microversion: 2.1 time: 0.290385 May 10 03:24:28.371391 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 394/796] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:24:28 2022] DELETE /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:24:28.379707 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-375efb42-54d3-4a07-b9f9-c4f54686674b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:28.380343 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-375efb42-54d3-4a07-b9f9-c4f54686674b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:28.386326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-375efb42-54d3-4a07-b9f9-c4f54686674b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:28.386783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-375efb42-54d3-4a07-b9f9-c4f54686674b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:28.387549 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-375efb42-54d3-4a07-b9f9-c4f54686674b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:28.387987 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-375efb42-54d3-4a07-b9f9-c4f54686674b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:28.516235 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-375efb42-54d3-4a07-b9f9-c4f54686674b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:28.524349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-375efb42-54d3-4a07-b9f9-c4f54686674b tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.148604 May 10 03:24:28.524943 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 403/797] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:28 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:24:29.255830 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-0fb0f0e5-8457-40b4-ad0d-95b4cbc8ecda tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:29.256561 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-0fb0f0e5-8457-40b4-ad0d-95b4cbc8ecda tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:29.262818 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0fb0f0e5-8457-40b4-ad0d-95b4cbc8ecda tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:29.263268 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0fb0f0e5-8457-40b4-ad0d-95b4cbc8ecda tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:29.264068 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0fb0f0e5-8457-40b4-ad0d-95b4cbc8ecda tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:29.264498 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0fb0f0e5-8457-40b4-ad0d-95b4cbc8ecda tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:29.401356 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-0fb0f0e5-8457-40b4-ad0d-95b4cbc8ecda tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:29.409472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-0fb0f0e5-8457-40b4-ad0d-95b4cbc8ecda tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:29.411050 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-0fb0f0e5-8457-40b4-ad0d-95b4cbc8ecda tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:29.412336 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-0fb0f0e5-8457-40b4-ad0d-95b4cbc8ecda tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1724 microversion: 2.20 time: 0.160790 May 10 03:24:29.413025 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 395/798] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:29 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:29.541037 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-8bb65ce5-000e-4082-a4a7-e057eea9b74f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:29.541651 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8bb65ce5-000e-4082-a4a7-e057eea9b74f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:29.548290 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8bb65ce5-000e-4082-a4a7-e057eea9b74f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:29.548746 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8bb65ce5-000e-4082-a4a7-e057eea9b74f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:29.550144 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8bb65ce5-000e-4082-a4a7-e057eea9b74f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:29.550587 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8bb65ce5-000e-4082-a4a7-e057eea9b74f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:29.715207 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8bb65ce5-000e-4082-a4a7-e057eea9b74f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:29.723962 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-8bb65ce5-000e-4082-a4a7-e057eea9b74f tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.186701 May 10 03:24:29.724898 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 404/799] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:29 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:24:30.430570 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-53b5e7f6-ff14-4ba0-9084-74cc50d5286f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:30.431203 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-53b5e7f6-ff14-4ba0-9084-74cc50d5286f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:30.437499 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-53b5e7f6-ff14-4ba0-9084-74cc50d5286f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:30.437941 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-53b5e7f6-ff14-4ba0-9084-74cc50d5286f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:30.438698 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-53b5e7f6-ff14-4ba0-9084-74cc50d5286f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:30.439128 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-53b5e7f6-ff14-4ba0-9084-74cc50d5286f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:30.570646 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-53b5e7f6-ff14-4ba0-9084-74cc50d5286f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:30.578286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-53b5e7f6-ff14-4ba0-9084-74cc50d5286f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:30.579758 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-53b5e7f6-ff14-4ba0-9084-74cc50d5286f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:30.581435 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-53b5e7f6-ff14-4ba0-9084-74cc50d5286f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1724 microversion: 2.20 time: 0.154699 May 10 03:24:30.581989 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 396/800] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:30 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:30.740396 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-05054f8c-5813-442e-963f-3780a2ae0728 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:30.740961 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-05054f8c-5813-442e-963f-3780a2ae0728 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:30.747203 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-05054f8c-5813-442e-963f-3780a2ae0728 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:30.747652 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-05054f8c-5813-442e-963f-3780a2ae0728 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:30.748456 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-05054f8c-5813-442e-963f-3780a2ae0728 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:30.748897 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-05054f8c-5813-442e-963f-3780a2ae0728 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:30.873287 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-05054f8c-5813-442e-963f-3780a2ae0728 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:30.880615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-05054f8c-5813-442e-963f-3780a2ae0728 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.144120 May 10 03:24:30.881189 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 405/801] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:30 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:24:31.599051 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-79907ebc-11e0-4bb8-acf7-cdb2e018fd4d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:31.599636 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-79907ebc-11e0-4bb8-acf7-cdb2e018fd4d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:31.605917 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-79907ebc-11e0-4bb8-acf7-cdb2e018fd4d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:31.606358 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-79907ebc-11e0-4bb8-acf7-cdb2e018fd4d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:31.607109 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-79907ebc-11e0-4bb8-acf7-cdb2e018fd4d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:31.607537 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-79907ebc-11e0-4bb8-acf7-cdb2e018fd4d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:31.734947 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-79907ebc-11e0-4bb8-acf7-cdb2e018fd4d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:31.743292 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-79907ebc-11e0-4bb8-acf7-cdb2e018fd4d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:31.744797 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-79907ebc-11e0-4bb8-acf7-cdb2e018fd4d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:31.745931 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-79907ebc-11e0-4bb8-acf7-cdb2e018fd4d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1724 microversion: 2.20 time: 0.150671 May 10 03:24:31.746479 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 397/802] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:31 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:31.896459 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-67f6d171-4a00-4aef-b726-3ee54d86202c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:31.897070 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-67f6d171-4a00-4aef-b726-3ee54d86202c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:31.903334 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-67f6d171-4a00-4aef-b726-3ee54d86202c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:31.903823 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-67f6d171-4a00-4aef-b726-3ee54d86202c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:31.904624 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-67f6d171-4a00-4aef-b726-3ee54d86202c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:31.905066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-67f6d171-4a00-4aef-b726-3ee54d86202c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:32.032324 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-67f6d171-4a00-4aef-b726-3ee54d86202c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:32.040417 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-67f6d171-4a00-4aef-b726-3ee54d86202c tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1523 microversion: 2.1 time: 0.147732 May 10 03:24:32.040981 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 406/803] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:31 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:24:32.585964 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-f3ee9085-f582-4d78-86d0-0db410129b7a req-fc7ca287-a61b-40cc-9c22-781419af570d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b289186d-a316-4521-92a0-4e13ae9b0083", "name": "network-vif-deleted", "tag": "9d61ae83-c5a2-4582-8cde-df85f658226e"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:24:32.593693 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-f3ee9085-f582-4d78-86d0-0db410129b7a req-fc7ca287-a61b-40cc-9c22-781419af570d service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:32.594154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-f3ee9085-f582-4d78-86d0-0db410129b7a req-fc7ca287-a61b-40cc-9c22-781419af570d service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:32.605463 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-f3ee9085-f582-4d78-86d0-0db410129b7a req-fc7ca287-a61b-40cc-9c22-781419af570d service nova] Creating event network-vif-deleted:9d61ae83-c5a2-4582-8cde-df85f658226e for instance b289186d-a316-4521-92a0-4e13ae9b0083 on hv-cinder-83009 May 10 03:24:32.611589 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-f3ee9085-f582-4d78-86d0-0db410129b7a req-fc7ca287-a61b-40cc-9c22-781419af570d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027836 May 10 03:24:32.611589 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 398/804] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:32.763671 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-38bf3650-9d08-46de-812a-c32beb779ab5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:32.764342 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-38bf3650-9d08-46de-812a-c32beb779ab5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:32.770930 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-38bf3650-9d08-46de-812a-c32beb779ab5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:32.776070 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-38bf3650-9d08-46de-812a-c32beb779ab5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:32.776070 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-38bf3650-9d08-46de-812a-c32beb779ab5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:32.776070 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-38bf3650-9d08-46de-812a-c32beb779ab5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:32.925190 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-38bf3650-9d08-46de-812a-c32beb779ab5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:32.934636 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-38bf3650-9d08-46de-812a-c32beb779ab5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:32.936174 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-38bf3650-9d08-46de-812a-c32beb779ab5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:32.937351 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-38bf3650-9d08-46de-812a-c32beb779ab5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1745 microversion: 2.20 time: 0.177506 May 10 03:24:32.937921 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 407/805] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:32 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:33.058362 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-7113dd49-c20b-4349-87da-2bcf413a4585 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:33.059061 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-7113dd49-c20b-4349-87da-2bcf413a4585 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:33.065783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7113dd49-c20b-4349-87da-2bcf413a4585 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:33.066240 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7113dd49-c20b-4349-87da-2bcf413a4585 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:33.067006 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7113dd49-c20b-4349-87da-2bcf413a4585 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:33.067454 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7113dd49-c20b-4349-87da-2bcf413a4585 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:33.096768 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7113dd49-c20b-4349-87da-2bcf413a4585 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:33.097158 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-7113dd49-c20b-4349-87da-2bcf413a4585 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:33.097605 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.objects.instance [None req-7113dd49-c20b-4349-87da-2bcf413a4585 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lazy-loading 'fault' on Instance uuid b289186d-a316-4521-92a0-4e13ae9b0083 {{(pid=117400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:24:33.138091 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-7113dd49-c20b-4349-87da-2bcf413a4585 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e309fb66a98b407d8b7533207e6a6dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e319a149db44fb8bb71f3066c82956', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:33.145272 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-7113dd49-c20b-4349-87da-2bcf413a4585 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 200 len: 1312 microversion: 2.1 time: 0.091075 May 10 03:24:33.145838 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 399/806] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:33 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 1312 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:24:33.956973 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-34fe4979-bfef-45be-abd0-b8a65f7f387b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:33.957613 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-34fe4979-bfef-45be-abd0-b8a65f7f387b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:33.963951 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-34fe4979-bfef-45be-abd0-b8a65f7f387b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:33.964434 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-34fe4979-bfef-45be-abd0-b8a65f7f387b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:33.965199 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-34fe4979-bfef-45be-abd0-b8a65f7f387b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:33.965640 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-34fe4979-bfef-45be-abd0-b8a65f7f387b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:34.090946 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-34fe4979-bfef-45be-abd0-b8a65f7f387b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:34.098592 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-34fe4979-bfef-45be-abd0-b8a65f7f387b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:34.100122 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-34fe4979-bfef-45be-abd0-b8a65f7f387b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:34.101281 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-34fe4979-bfef-45be-abd0-b8a65f7f387b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1745 microversion: 2.20 time: 0.148805 May 10 03:24:34.101847 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 408/807] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:33 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1745 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:34.161845 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-36bd513b-fc54-47a7-b285-49990d485259 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:34.162451 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-36bd513b-fc54-47a7-b285-49990d485259 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] [instance: b289186d-a316-4521-92a0-4e13ae9b0083] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:34.168707 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-36bd513b-fc54-47a7-b285-49990d485259 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:34.169148 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-36bd513b-fc54-47a7-b285-49990d485259 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:34.169912 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-36bd513b-fc54-47a7-b285-49990d485259 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:34.170338 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-36bd513b-fc54-47a7-b285-49990d485259 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:34.183371 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-36bd513b-fc54-47a7-b285-49990d485259 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] HTTP exception thrown: Instance b289186d-a316-4521-92a0-4e13ae9b0083 could not be found. May 10 03:24:34.185850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-36bd513b-fc54-47a7-b285-49990d485259 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Request method failure captured: May 10 03:24:34.185850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 HTTP/1.1 May 10 03:24:34.185850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:24:34.185850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:24:34.185850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:24:34.185850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:24:34.185850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:24:34.185850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:24:34.185850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:24:34.185850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:24:34.185850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedm4YBo_VeiW-S1UxjlvvKNx7u6jWbPbvvm0pYOm5amQBwu7q0C7Rd8nGSaIclBMXEqqaxCizBVj7NePFJ1eCV8CTM1okztCGz5tsrL80ntHdSO2lpXeHCYcWrqg_AqJQDp6ALaVfEt1ayCvEgCMFkenfpQm-YCKlUpXTGJxCi7gX6Y May 10 03:24:34.185850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:24:34.185850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:24:34.185850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:24:34.185850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:24:34.185850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:24:34.185850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:24:34.185850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: d8e319a149db44fb8bb71f3066c82956 May 10 03:24:34.185850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1946563297 May 10 03:24:34.185850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:24:34.185850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:24:34.187122 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d8e319a149db44fb8bb71f3066c82956", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8e319a149db44fb8bb71f3066c82956"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d8e319a149db44fb8bb71f3066c82956"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d8e319a149db44fb8bb71f3066c82956"}]}] May 10 03:24:34.187122 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1946563297 May 10 03:24:34.187122 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: d8e319a149db44fb8bb71f3066c82956 May 10 03:24:34.187122 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1946563297 May 10 03:24:34.187122 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-ServerRescueNegativeTestJSON-1946563297-project May 10 03:24:34.187122 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:24:34.187122 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:24:34.187122 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: e309fb66a98b407d8b7533207e6a6dfc May 10 03:24:34.187122 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1946563297-project May 10 03:24:34.187122 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:24:34.187122 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Instance b289186d-a316-4521-92a0-4e13ae9b0083 could not be found. May 10 03:24:34.187122 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'id': 'b289186d-a316-4521-92a0-4e13ae9b0083'} May 10 03:24:34.187933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:24:34.187933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:24:34.187933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:24:34.187933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:24:34.187933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:24:34.187933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:24:34.187933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:24:34.187933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:24:34.187933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:24:34.187933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:24:34.187933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b289186d-a316-4521-92a0-4e13ae9b0083 could not be found. May 10 03:24:34.187933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:34.187933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:24:34.187933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:34.187933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:24:34.187933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:24:34.187933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:24:34.187933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:24:34.187933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:24:34.187933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:24:34.189420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:24:34.189420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:24:34.189420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:24:34.189420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:24:34.189420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:24:34.189420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:24:34.189420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:24:34.189420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b289186d-a316-4521-92a0-4e13ae9b0083 could not be found. May 10 03:24:34.189420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:34.189420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:24:34.189420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:34.189420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:24:34.189420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:24:34.189420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:24:34.189420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:24:34.189420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:24:34.189420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b289186d-a316-4521-92a0-4e13ae9b0083 could not be found. May 10 03:24:34.189420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:34.191284 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-36bd513b-fc54-47a7-b285-49990d485259 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] Returning 404 to user: Instance b289186d-a316-4521-92a0-4e13ae9b0083 could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:24:34.191284 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-36bd513b-fc54-47a7-b285-49990d485259 tempest-ServerRescueNegativeTestJSON-1946563297 tempest-ServerRescueNegativeTestJSON-1946563297-project] 10.222.0.65 "GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083" status: 404 len: 111 microversion: 2.1 time: 0.029209 May 10 03:24:34.191284 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 400/808] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:34 2022] GET /compute/v2.1/servers/b289186d-a316-4521-92a0-4e13ae9b0083 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:24:35.037807 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-dba51653-31d1-45a6-b3f8-03571777249e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:35.040176 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-dba51653-31d1-45a6-b3f8-03571777249e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:35.044615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dba51653-31d1-45a6-b3f8-03571777249e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:35.045069 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dba51653-31d1-45a6-b3f8-03571777249e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:35.046296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dba51653-31d1-45a6-b3f8-03571777249e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:35.046725 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dba51653-31d1-45a6-b3f8-03571777249e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:35.071185 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-dba51653-31d1-45a6-b3f8-03571777249e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/ips" status: 200 len: 146 microversion: 2.1 time: 0.214720 May 10 03:24:35.072103 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 409/809] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 10 03:24:34 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/ips => generated 146 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:35.119708 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-f573465b-6537-4c61-bc84-a5001a2f307c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:35.120605 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-f573465b-6537-4c61-bc84-a5001a2f307c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:35.127209 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f573465b-6537-4c61-bc84-a5001a2f307c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:35.127822 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f573465b-6537-4c61-bc84-a5001a2f307c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:35.128845 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f573465b-6537-4c61-bc84-a5001a2f307c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:35.129419 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f573465b-6537-4c61-bc84-a5001a2f307c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:35.292573 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-f573465b-6537-4c61-bc84-a5001a2f307c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:35.301445 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-f573465b-6537-4c61-bc84-a5001a2f307c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:35.302952 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-f573465b-6537-4c61-bc84-a5001a2f307c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:35.304137 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-f573465b-6537-4c61-bc84-a5001a2f307c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1740 microversion: 2.20 time: 0.188921 May 10 03:24:35.304691 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 401/810] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:35 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:36.322998 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-95da5532-bd97-419a-8114-33335c8c1fa4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:36.323746 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-95da5532-bd97-419a-8114-33335c8c1fa4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:36.333017 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-95da5532-bd97-419a-8114-33335c8c1fa4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:36.335597 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-95da5532-bd97-419a-8114-33335c8c1fa4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:36.337788 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-95da5532-bd97-419a-8114-33335c8c1fa4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:36.339191 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-95da5532-bd97-419a-8114-33335c8c1fa4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:36.580505 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-95da5532-bd97-419a-8114-33335c8c1fa4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:36.592758 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-95da5532-bd97-419a-8114-33335c8c1fa4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:36.608872 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-95da5532-bd97-419a-8114-33335c8c1fa4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:36.614449 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-95da5532-bd97-419a-8114-33335c8c1fa4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1740 microversion: 2.20 time: 0.292838 May 10 03:24:36.615316 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 410/811] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:36 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1740 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:24:36.715436 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-b1eef9fd-a005-46ed-8510-935965e1b979 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "123b7290-311f-4312-9e3f-0facb77c2c7f"}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:24:36.717715 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-b1eef9fd-a005-46ed-8510-935965e1b979 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:36.734365 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b1eef9fd-a005-46ed-8510-935965e1b979 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:36.735110 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b1eef9fd-a005-46ed-8510-935965e1b979 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:36.736738 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b1eef9fd-a005-46ed-8510-935965e1b979 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:36.740211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b1eef9fd-a005-46ed-8510-935965e1b979 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:37.093195 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-567f82ec-4c5d-4608-9a19-3f23afd89e0f req-9dc5015b-fc35-41d6-96a0-0105f7d6d8a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d490231e-628d-467d-a571-2538c3646f1e", "name": "network-vif-plugged", "status": "completed", "tag": "e8ecbe35-34e0-4751-a0e4-9587716eaf81"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:24:37.103927 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-567f82ec-4c5d-4608-9a19-3f23afd89e0f req-9dc5015b-fc35-41d6-96a0-0105f7d6d8a7 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:37.104926 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-567f82ec-4c5d-4608-9a19-3f23afd89e0f req-9dc5015b-fc35-41d6-96a0-0105f7d6d8a7 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:37.127795 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-567f82ec-4c5d-4608-9a19-3f23afd89e0f req-9dc5015b-fc35-41d6-96a0-0105f7d6d8a7 service nova] Creating event network-vif-plugged:e8ecbe35-34e0-4751-a0e4-9587716eaf81 for instance d490231e-628d-467d-a571-2538c3646f1e on hv-cinder-83009 May 10 03:24:37.134572 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-567f82ec-4c5d-4608-9a19-3f23afd89e0f req-9dc5015b-fc35-41d6-96a0-0105f7d6d8a7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202814 May 10 03:24:37.135476 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 411/812] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:37.553454 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-b1eef9fd-a005-46ed-8510-935965e1b979 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "POST /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.842745 May 10 03:24:37.554078 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 402/813] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 03:24:36 2022] POST /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-volume_attachments => generated 194 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:37.634818 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-be80a163-9891-4c93-ae9d-30766da08ae5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:37.636198 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-be80a163-9891-4c93-ae9d-30766da08ae5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:37.665014 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-be80a163-9891-4c93-ae9d-30766da08ae5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:37.666987 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-be80a163-9891-4c93-ae9d-30766da08ae5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:37.668562 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-be80a163-9891-4c93-ae9d-30766da08ae5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:37.673822 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-be80a163-9891-4c93-ae9d-30766da08ae5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:37.922811 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-be80a163-9891-4c93-ae9d-30766da08ae5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:37.934834 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-be80a163-9891-4c93-ae9d-30766da08ae5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:37.936711 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-be80a163-9891-4c93-ae9d-30766da08ae5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:37.938471 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-be80a163-9891-4c93-ae9d-30766da08ae5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1740 microversion: 2.20 time: 0.309455 May 10 03:24:37.953508 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 412/814] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:37 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1740 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:38.959547 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-43eca1fe-f384-4012-92b9-6a754b2edb62 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:38.960188 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-43eca1fe-f384-4012-92b9-6a754b2edb62 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:38.966946 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-43eca1fe-f384-4012-92b9-6a754b2edb62 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:38.967715 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-43eca1fe-f384-4012-92b9-6a754b2edb62 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:38.968731 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-43eca1fe-f384-4012-92b9-6a754b2edb62 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:38.969170 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-43eca1fe-f384-4012-92b9-6a754b2edb62 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:39.139027 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-43eca1fe-f384-4012-92b9-6a754b2edb62 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:39.151605 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-43eca1fe-f384-4012-92b9-6a754b2edb62 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:39.153326 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-43eca1fe-f384-4012-92b9-6a754b2edb62 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:39.154500 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-43eca1fe-f384-4012-92b9-6a754b2edb62 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1740 microversion: 2.20 time: 0.200952 May 10 03:24:39.155198 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 403/815] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:38 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:40.175774 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c0f9ccf2-4723-4f57-8597-40e04a5088f6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:40.177245 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-c0f9ccf2-4723-4f57-8597-40e04a5088f6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:40.184786 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c0f9ccf2-4723-4f57-8597-40e04a5088f6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:40.187062 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c0f9ccf2-4723-4f57-8597-40e04a5088f6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:40.187062 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c0f9ccf2-4723-4f57-8597-40e04a5088f6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:40.187062 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c0f9ccf2-4723-4f57-8597-40e04a5088f6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:40.337863 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-c0f9ccf2-4723-4f57-8597-40e04a5088f6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:40.348191 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-c0f9ccf2-4723-4f57-8597-40e04a5088f6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:40.350271 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-c0f9ccf2-4723-4f57-8597-40e04a5088f6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:40.351406 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-c0f9ccf2-4723-4f57-8597-40e04a5088f6 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1740 microversion: 2.20 time: 0.180703 May 10 03:24:40.356773 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 413/816] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:40 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:40.930065 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-d1ed3e12-36a0-445f-a75a-3aed64f14391 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:40.931174 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-d1ed3e12-36a0-445f-a75a-3aed64f14391 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:40.937771 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d1ed3e12-36a0-445f-a75a-3aed64f14391 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:40.938222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d1ed3e12-36a0-445f-a75a-3aed64f14391 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:40.938981 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d1ed3e12-36a0-445f-a75a-3aed64f14391 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:40.939583 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d1ed3e12-36a0-445f-a75a-3aed64f14391 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:40.986991 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-d1ed3e12-36a0-445f-a75a-3aed64f14391 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060489 May 10 03:24:40.997518 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-3fb38d20-58c1-43f8-98bb-f19a0e0b3fb4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:40.998029 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-3fb38d20-58c1-43f8-98bb-f19a0e0b3fb4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:41.003788 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 404/817] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 03:24:40 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:41.006102 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3fb38d20-58c1-43f8-98bb-f19a0e0b3fb4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:41.006560 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3fb38d20-58c1-43f8-98bb-f19a0e0b3fb4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:41.007347 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3fb38d20-58c1-43f8-98bb-f19a0e0b3fb4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:41.007914 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3fb38d20-58c1-43f8-98bb-f19a0e0b3fb4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:41.039735 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-3fb38d20-58c1-43f8-98bb-f19a0e0b3fb4 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-volume_attachments/123b7290-311f-4312-9e3f-0facb77c2c7f" status: 200 len: 194 microversion: 2.1 time: 0.047960 May 10 03:24:41.045379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 414/818] 10.222.0.65 () {58 vars in 1412 bytes} [Tue May 10 03:24:40 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-volume_attachments/123b7290-311f-4312-9e3f-0facb77c2c7f => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:41.370237 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-69d584b0-44fe-4735-b9cc-f3f0ea0f8ed7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:41.371035 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-69d584b0-44fe-4735-b9cc-f3f0ea0f8ed7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:41.380953 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-69d584b0-44fe-4735-b9cc-f3f0ea0f8ed7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:41.381770 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-69d584b0-44fe-4735-b9cc-f3f0ea0f8ed7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:41.382793 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-69d584b0-44fe-4735-b9cc-f3f0ea0f8ed7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:41.383494 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-69d584b0-44fe-4735-b9cc-f3f0ea0f8ed7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:41.549190 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-69d584b0-44fe-4735-b9cc-f3f0ea0f8ed7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:41.564279 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-69d584b0-44fe-4735-b9cc-f3f0ea0f8ed7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:41.566944 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-69d584b0-44fe-4735-b9cc-f3f0ea0f8ed7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:41.568345 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-69d584b0-44fe-4735-b9cc-f3f0ea0f8ed7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1740 microversion: 2.20 time: 0.202195 May 10 03:24:41.569329 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 405/819] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:41 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:42.587639 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-b1443f41-c1b9-4ce0-a9b5-8981aa633b37 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:42.588195 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-b1443f41-c1b9-4ce0-a9b5-8981aa633b37 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:42.594320 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b1443f41-c1b9-4ce0-a9b5-8981aa633b37 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:42.594950 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b1443f41-c1b9-4ce0-a9b5-8981aa633b37 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:42.595588 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b1443f41-c1b9-4ce0-a9b5-8981aa633b37 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:42.596060 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b1443f41-c1b9-4ce0-a9b5-8981aa633b37 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:42.742033 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-1a4ce63c-1518-4665-8eea-a622f5f1f0f3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3d44d77-181a-4169-bf1a-7692cee6a1e0"}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:24:42.743408 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-1a4ce63c-1518-4665-8eea-a622f5f1f0f3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:42.748496 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-b1443f41-c1b9-4ce0-a9b5-8981aa633b37 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:42.751424 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1a4ce63c-1518-4665-8eea-a622f5f1f0f3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:42.752037 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1a4ce63c-1518-4665-8eea-a622f5f1f0f3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:42.753228 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1a4ce63c-1518-4665-8eea-a622f5f1f0f3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:42.753927 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1a4ce63c-1518-4665-8eea-a622f5f1f0f3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:42.756302 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-b1443f41-c1b9-4ce0-a9b5-8981aa633b37 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:42.757838 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-b1443f41-c1b9-4ce0-a9b5-8981aa633b37 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:42.759187 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-b1443f41-c1b9-4ce0-a9b5-8981aa633b37 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1740 microversion: 2.20 time: 0.176136 May 10 03:24:42.759742 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 415/820] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:42 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:43.434373 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-1a4ce63c-1518-4665-8eea-a622f5f1f0f3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "POST /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.695610 May 10 03:24:43.435184 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 406/821] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 03:24:42 2022] POST /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-volume_attachments => generated 194 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:24:43.781060 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a18a5054-c1f1-4334-a239-e5c2ee982d21 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:43.782487 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-a18a5054-c1f1-4334-a239-e5c2ee982d21 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:43.789892 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a18a5054-c1f1-4334-a239-e5c2ee982d21 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:43.790554 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a18a5054-c1f1-4334-a239-e5c2ee982d21 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:43.791494 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a18a5054-c1f1-4334-a239-e5c2ee982d21 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:43.792105 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a18a5054-c1f1-4334-a239-e5c2ee982d21 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:43.861168 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-168f717f-01a7-4b83-87db-522e84444d7a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:43.864164 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-168f717f-01a7-4b83-87db-522e84444d7a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:43.875026 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-168f717f-01a7-4b83-87db-522e84444d7a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:43.876990 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-168f717f-01a7-4b83-87db-522e84444d7a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:43.879292 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-168f717f-01a7-4b83-87db-522e84444d7a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:43.881386 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-168f717f-01a7-4b83-87db-522e84444d7a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:43.907721 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-168f717f-01a7-4b83-87db-522e84444d7a tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827/ips" status: 200 len: 151 microversion: 2.1 time: 0.296640 May 10 03:24:43.917893 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 416/822] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 10 03:24:43 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827/ips => generated 151 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:43.989445 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-a18a5054-c1f1-4334-a239-e5c2ee982d21 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:43.991786 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-a18a5054-c1f1-4334-a239-e5c2ee982d21 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:43.994876 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-a18a5054-c1f1-4334-a239-e5c2ee982d21 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:43.996288 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-a18a5054-c1f1-4334-a239-e5c2ee982d21 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1740 microversion: 2.20 time: 0.222067 May 10 03:24:44.004248 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 407/823] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:43 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:24:45.014450 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-8f66517f-ad53-42f7-b5d2-e97a707b5731 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:45.015175 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8f66517f-ad53-42f7-b5d2-e97a707b5731 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:45.021753 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8f66517f-ad53-42f7-b5d2-e97a707b5731 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:45.022323 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8f66517f-ad53-42f7-b5d2-e97a707b5731 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:45.023258 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8f66517f-ad53-42f7-b5d2-e97a707b5731 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:45.023748 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8f66517f-ad53-42f7-b5d2-e97a707b5731 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:45.175400 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8f66517f-ad53-42f7-b5d2-e97a707b5731 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:45.191185 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8f66517f-ad53-42f7-b5d2-e97a707b5731 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:45.193666 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-8f66517f-ad53-42f7-b5d2-e97a707b5731 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:45.195658 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-8f66517f-ad53-42f7-b5d2-e97a707b5731 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1740 microversion: 2.20 time: 0.185001 May 10 03:24:45.197193 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 417/824] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:45 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:45.642687 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-33efe77c-1941-4fef-bcaf-0e19546a2587 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "859d7501-a000-48fe-b553-26f6aa5aeef4"}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:24:45.650632 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-33efe77c-1941-4fef-bcaf-0e19546a2587 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:45.661582 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-33efe77c-1941-4fef-bcaf-0e19546a2587 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:45.665243 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-33efe77c-1941-4fef-bcaf-0e19546a2587 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:45.668175 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-33efe77c-1941-4fef-bcaf-0e19546a2587 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:45.668923 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-33efe77c-1941-4fef-bcaf-0e19546a2587 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:45.892271 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e8891872-339d-4283-ab62-70a9aec71b22 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:45.893946 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-e8891872-339d-4283-ab62-70a9aec71b22 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:45.901478 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e8891872-339d-4283-ab62-70a9aec71b22 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:45.902024 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e8891872-339d-4283-ab62-70a9aec71b22 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:45.902974 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e8891872-339d-4283-ab62-70a9aec71b22 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:45.903636 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e8891872-339d-4283-ab62-70a9aec71b22 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:45.937072 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-e8891872-339d-4283-ab62-70a9aec71b22 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051024 May 10 03:24:45.937657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 418/825] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 03:24:45 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:46.084747 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-979099f9-a0be-43ba-8f70-29dcce6f896c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:46.085357 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-979099f9-a0be-43ba-8f70-29dcce6f896c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:46.091817 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-979099f9-a0be-43ba-8f70-29dcce6f896c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:46.092300 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-979099f9-a0be-43ba-8f70-29dcce6f896c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:46.093064 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-979099f9-a0be-43ba-8f70-29dcce6f896c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:46.093498 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-979099f9-a0be-43ba-8f70-29dcce6f896c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:46.123609 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-979099f9-a0be-43ba-8f70-29dcce6f896c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-volume_attachments/123b7290-311f-4312-9e3f-0facb77c2c7f" status: 200 len: 194 microversion: 2.1 time: 0.044229 May 10 03:24:46.124217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 419/826] 10.222.0.65 () {58 vars in 1412 bytes} [Tue May 10 03:24:46 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-volume_attachments/123b7290-311f-4312-9e3f-0facb77c2c7f => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:24:46.133905 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-2fa066eb-7410-4c59-93cc-dfd789105a80 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:46.134394 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-2fa066eb-7410-4c59-93cc-dfd789105a80 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:46.143136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2fa066eb-7410-4c59-93cc-dfd789105a80 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:46.144298 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2fa066eb-7410-4c59-93cc-dfd789105a80 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:46.145102 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2fa066eb-7410-4c59-93cc-dfd789105a80 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:46.145552 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2fa066eb-7410-4c59-93cc-dfd789105a80 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:46.228886 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.objects.instance [None req-2fa066eb-7410-4c59-93cc-dfd789105a80 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lazy-loading 'services' on Instance uuid 9adf1a01-7c6f-4ad0-8b62-643d71caec83 {{(pid=117399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:24:46.553517 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-2fa066eb-7410-4c59-93cc-dfd789105a80 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-volume_attachments/123b7290-311f-4312-9e3f-0facb77c2c7f" status: 202 len: 0 microversion: 2.1 time: 0.422995 May 10 03:24:46.554385 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 420/827] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 10 03:24:46 2022] DELETE /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-volume_attachments/123b7290-311f-4312-9e3f-0facb77c2c7f => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 03:24:46.559846 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ac9ceba9-71da-43b6-9a09-685df4d855e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:46.560537 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ac9ceba9-71da-43b6-9a09-685df4d855e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:46.569605 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ac9ceba9-71da-43b6-9a09-685df4d855e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:46.569605 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ac9ceba9-71da-43b6-9a09-685df4d855e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:46.569796 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ac9ceba9-71da-43b6-9a09-685df4d855e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:46.570172 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ac9ceba9-71da-43b6-9a09-685df4d855e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:46.737467 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ac9ceba9-71da-43b6-9a09-685df4d855e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:46.752598 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ac9ceba9-71da-43b6-9a09-685df4d855e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:46.755674 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ac9ceba9-71da-43b6-9a09-685df4d855e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:46.758101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ac9ceba9-71da-43b6-9a09-685df4d855e0 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1740 microversion: 2.20 time: 0.202574 May 10 03:24:46.759936 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 421/828] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:46 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:46.964711 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-33efe77c-1941-4fef-bcaf-0e19546a2587 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "POST /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.325480 May 10 03:24:46.979305 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 408/829] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 03:24:45 2022] POST /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827/os-volume_attachments => generated 194 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:47.778819 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-fc00e533-1d27-4444-9c09-ebcb019a9b34 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:47.779576 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-fc00e533-1d27-4444-9c09-ebcb019a9b34 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:47.781790 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-2e0ba414-f8a6-4496-a175-4a9629b37653 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:47.782376 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-2e0ba414-f8a6-4496-a175-4a9629b37653 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:47.788909 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2e0ba414-f8a6-4496-a175-4a9629b37653 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:47.789366 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2e0ba414-f8a6-4496-a175-4a9629b37653 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:47.790157 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2e0ba414-f8a6-4496-a175-4a9629b37653 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:47.790582 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2e0ba414-f8a6-4496-a175-4a9629b37653 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:47.796819 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fc00e533-1d27-4444-9c09-ebcb019a9b34 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:47.801132 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fc00e533-1d27-4444-9c09-ebcb019a9b34 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:47.801132 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fc00e533-1d27-4444-9c09-ebcb019a9b34 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:47.801132 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fc00e533-1d27-4444-9c09-ebcb019a9b34 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:47.827036 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-2e0ba414-f8a6-4496-a175-4a9629b37653 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-volume_attachments/e3d44d77-181a-4169-bf1a-7692cee6a1e0" status: 200 len: 194 microversion: 2.1 time: 0.057530 May 10 03:24:47.832820 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 422/830] 10.222.0.65 () {58 vars in 1412 bytes} [Tue May 10 03:24:47 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-volume_attachments/e3d44d77-181a-4169-bf1a-7692cee6a1e0 => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:47.840408 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-8b77170c-edea-42ea-bf36-bb3cceb9cb0b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:47.841041 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8b77170c-edea-42ea-bf36-bb3cceb9cb0b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:47.848441 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8b77170c-edea-42ea-bf36-bb3cceb9cb0b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:47.852630 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8b77170c-edea-42ea-bf36-bb3cceb9cb0b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:47.852630 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8b77170c-edea-42ea-bf36-bb3cceb9cb0b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:47.852630 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8b77170c-edea-42ea-bf36-bb3cceb9cb0b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:47.935699 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.objects.instance [None req-8b77170c-edea-42ea-bf36-bb3cceb9cb0b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lazy-loading 'services' on Instance uuid 9adf1a01-7c6f-4ad0-8b62-643d71caec83 {{(pid=117399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:24:47.957950 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-fc00e533-1d27-4444-9c09-ebcb019a9b34 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:47.966136 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-fc00e533-1d27-4444-9c09-ebcb019a9b34 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:47.967713 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-fc00e533-1d27-4444-9c09-ebcb019a9b34 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:47.968974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-fc00e533-1d27-4444-9c09-ebcb019a9b34 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1740 microversion: 2.20 time: 0.195017 May 10 03:24:47.980120 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 409/831] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:47 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:48.126619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-8b77170c-edea-42ea-bf36-bb3cceb9cb0b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-volume_attachments/e3d44d77-181a-4169-bf1a-7692cee6a1e0" status: 202 len: 0 microversion: 2.1 time: 0.289444 May 10 03:24:48.126619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 423/832] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 10 03:24:47 2022] DELETE /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-volume_attachments/e3d44d77-181a-4169-bf1a-7692cee6a1e0 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:24:48.990208 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-868683a2-0dfa-4e7b-a3e6-d2234dc2d22b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:48.991116 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-868683a2-0dfa-4e7b-a3e6-d2234dc2d22b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:48.997644 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-868683a2-0dfa-4e7b-a3e6-d2234dc2d22b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:48.998015 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-868683a2-0dfa-4e7b-a3e6-d2234dc2d22b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:48.998869 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-868683a2-0dfa-4e7b-a3e6-d2234dc2d22b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:48.999318 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-868683a2-0dfa-4e7b-a3e6-d2234dc2d22b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:49.139976 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-868683a2-0dfa-4e7b-a3e6-d2234dc2d22b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:49.151347 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-868683a2-0dfa-4e7b-a3e6-d2234dc2d22b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:49.153611 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-868683a2-0dfa-4e7b-a3e6-d2234dc2d22b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:49.155323 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-868683a2-0dfa-4e7b-a3e6-d2234dc2d22b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1722 microversion: 2.20 time: 0.169669 May 10 03:24:49.170120 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 410/833] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:48 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:50.179426 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-7f51ca07-3e9f-4e07-a784-45dc3393607a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:50.180202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-7f51ca07-3e9f-4e07-a784-45dc3393607a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:50.186482 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7f51ca07-3e9f-4e07-a784-45dc3393607a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:50.186889 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7f51ca07-3e9f-4e07-a784-45dc3393607a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:50.187669 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7f51ca07-3e9f-4e07-a784-45dc3393607a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:50.188142 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7f51ca07-3e9f-4e07-a784-45dc3393607a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:50.329360 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-7f51ca07-3e9f-4e07-a784-45dc3393607a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:50.337972 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-7f51ca07-3e9f-4e07-a784-45dc3393607a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:50.339468 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-7f51ca07-3e9f-4e07-a784-45dc3393607a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:50.340662 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-7f51ca07-3e9f-4e07-a784-45dc3393607a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1722 microversion: 2.20 time: 0.166667 May 10 03:24:50.341533 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 424/834] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:50 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:50.359500 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-81d71bed-be9b-4c91-8a46-634239450c16 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:50.360510 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-81d71bed-be9b-4c91-8a46-634239450c16 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:50.366537 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-81d71bed-be9b-4c91-8a46-634239450c16 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:50.366978 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-81d71bed-be9b-4c91-8a46-634239450c16 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:50.367744 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-81d71bed-be9b-4c91-8a46-634239450c16 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:50.368210 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-81d71bed-be9b-4c91-8a46-634239450c16 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:50.397063 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-81d71bed-be9b-4c91-8a46-634239450c16 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041297 May 10 03:24:50.403745 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 411/835] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 03:24:50 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:24:50.410988 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-eccc635c-8846-47d4-92e6-e927e66e9109 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:50.410988 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-eccc635c-8846-47d4-92e6-e927e66e9109 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:50.414289 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-eccc635c-8846-47d4-92e6-e927e66e9109 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:50.414746 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-eccc635c-8846-47d4-92e6-e927e66e9109 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:50.415736 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-eccc635c-8846-47d4-92e6-e927e66e9109 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:50.416402 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-eccc635c-8846-47d4-92e6-e927e66e9109 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:50.512063 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.objects.instance [None req-eccc635c-8846-47d4-92e6-e927e66e9109 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lazy-loading 'services' on Instance uuid 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 {{(pid=117399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:24:50.516400 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-b8dadf19-7489-4dc3-88ab-1973e8de7fc3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:50.517415 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-b8dadf19-7489-4dc3-88ab-1973e8de7fc3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:50.523866 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b8dadf19-7489-4dc3-88ab-1973e8de7fc3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:50.524364 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b8dadf19-7489-4dc3-88ab-1973e8de7fc3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:50.525144 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b8dadf19-7489-4dc3-88ab-1973e8de7fc3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:50.525584 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b8dadf19-7489-4dc3-88ab-1973e8de7fc3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:50.555380 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-b8dadf19-7489-4dc3-88ab-1973e8de7fc3 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043008 May 10 03:24:50.555951 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 412/836] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 03:24:50 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 03:24:50.617410 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-4e76dccd-06e5-4a8e-b189-d5f408a11ebe tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:50.617910 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-4e76dccd-06e5-4a8e-b189-d5f408a11ebe tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:50.623614 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4e76dccd-06e5-4a8e-b189-d5f408a11ebe tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:50.624208 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4e76dccd-06e5-4a8e-b189-d5f408a11ebe tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:50.624974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4e76dccd-06e5-4a8e-b189-d5f408a11ebe tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:50.625407 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4e76dccd-06e5-4a8e-b189-d5f408a11ebe tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:50.650939 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-4e76dccd-06e5-4a8e-b189-d5f408a11ebe tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Going to try to terminate instance {{(pid=117400) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:24:50.718569 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-eccc635c-8846-47d4-92e6-e927e66e9109 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "DELETE /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827/os-volume_attachments/859d7501-a000-48fe-b553-26f6aa5aeef4" status: 202 len: 0 microversion: 2.1 time: 0.316665 May 10 03:24:50.719191 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 425/837] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 10 03:24:50 2022] DELETE /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827/os-volume_attachments/859d7501-a000-48fe-b553-26f6aa5aeef4 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:24:50.727806 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-763cbfc3-845e-491f-bc82-5e87847b70e1 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:50.728915 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-763cbfc3-845e-491f-bc82-5e87847b70e1 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:50.734938 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-763cbfc3-845e-491f-bc82-5e87847b70e1 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:50.735391 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-763cbfc3-845e-491f-bc82-5e87847b70e1 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:50.736192 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-763cbfc3-845e-491f-bc82-5e87847b70e1 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:50.736633 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-763cbfc3-845e-491f-bc82-5e87847b70e1 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:50.765983 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-763cbfc3-845e-491f-bc82-5e87847b70e1 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042233 May 10 03:24:50.766805 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 426/838] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 03:24:50 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:24:50.939146 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-4e76dccd-06e5-4a8e-b189-d5f408a11ebe tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 204 len: 0 microversion: 2.1 time: 0.322210 May 10 03:24:50.939146 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 413/839] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:24:50 2022] DELETE /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 03:24:50.945772 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-eeed2cf5-2c99-4004-a4af-02fea3d5e07a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:50.946375 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-eeed2cf5-2c99-4004-a4af-02fea3d5e07a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:50.952254 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-eeed2cf5-2c99-4004-a4af-02fea3d5e07a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:50.952702 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-eeed2cf5-2c99-4004-a4af-02fea3d5e07a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:50.953456 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-eeed2cf5-2c99-4004-a4af-02fea3d5e07a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:50.953890 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-eeed2cf5-2c99-4004-a4af-02fea3d5e07a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:51.085406 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-eeed2cf5-2c99-4004-a4af-02fea3d5e07a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:51.092605 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-eeed2cf5-2c99-4004-a4af-02fea3d5e07a tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 200 len: 1674 microversion: 2.1 time: 0.150949 May 10 03:24:51.093180 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 427/840] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:50 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:24:51.359211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-aacd2c69-b858-4e1c-a7ad-47032d3c34a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:51.360024 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-aacd2c69-b858-4e1c-a7ad-47032d3c34a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:51.366472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-aacd2c69-b858-4e1c-a7ad-47032d3c34a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:51.366915 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-aacd2c69-b858-4e1c-a7ad-47032d3c34a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:51.367679 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-aacd2c69-b858-4e1c-a7ad-47032d3c34a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:51.368164 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-aacd2c69-b858-4e1c-a7ad-47032d3c34a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:51.501045 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-aacd2c69-b858-4e1c-a7ad-47032d3c34a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:51.509523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-aacd2c69-b858-4e1c-a7ad-47032d3c34a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:51.511027 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-aacd2c69-b858-4e1c-a7ad-47032d3c34a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:51.512217 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-aacd2c69-b858-4e1c-a7ad-47032d3c34a4 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1722 microversion: 2.20 time: 0.157268 May 10 03:24:51.512777 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 414/841] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:51 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:51.778231 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e5430337-c76f-4f32-afe6-5c4315386994 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:51.779078 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-e5430337-c76f-4f32-afe6-5c4315386994 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:51.786291 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e5430337-c76f-4f32-afe6-5c4315386994 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:51.786744 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e5430337-c76f-4f32-afe6-5c4315386994 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:51.787512 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e5430337-c76f-4f32-afe6-5c4315386994 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:51.787956 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e5430337-c76f-4f32-afe6-5c4315386994 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:51.818119 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-e5430337-c76f-4f32-afe6-5c4315386994 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043819 May 10 03:24:51.818732 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 428/842] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 03:24:51 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:52.110357 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-be782b5d-5f71-4cdc-9e77-644ffaaf49e0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:52.111037 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-be782b5d-5f71-4cdc-9e77-644ffaaf49e0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:52.116880 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-be782b5d-5f71-4cdc-9e77-644ffaaf49e0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:52.117333 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-be782b5d-5f71-4cdc-9e77-644ffaaf49e0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:52.119871 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-be782b5d-5f71-4cdc-9e77-644ffaaf49e0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:52.119871 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-be782b5d-5f71-4cdc-9e77-644ffaaf49e0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:52.244554 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-be782b5d-5f71-4cdc-9e77-644ffaaf49e0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:52.251806 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-be782b5d-5f71-4cdc-9e77-644ffaaf49e0 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 200 len: 1674 microversion: 2.1 time: 0.145250 May 10 03:24:52.253147 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 415/843] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:52 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 1674 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:24:52.531875 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-1defae17-e521-4f9a-8a4c-d79cfc0d9d6f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:52.532531 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-1defae17-e521-4f9a-8a4c-d79cfc0d9d6f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:52.538655 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1defae17-e521-4f9a-8a4c-d79cfc0d9d6f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:52.539113 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1defae17-e521-4f9a-8a4c-d79cfc0d9d6f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:52.539975 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1defae17-e521-4f9a-8a4c-d79cfc0d9d6f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:52.540470 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1defae17-e521-4f9a-8a4c-d79cfc0d9d6f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:52.631631 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-61e6d362-47a8-4d63-b69d-02f523805df4 req-879923e4-d9fd-4fb6-ad1a-01b4ea7be0a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d490231e-628d-467d-a571-2538c3646f1e", "name": "network-vif-unplugged", "status": "completed", "tag": "e8ecbe35-34e0-4751-a0e4-9587716eaf81"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:24:52.642505 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-61e6d362-47a8-4d63-b69d-02f523805df4 req-879923e4-d9fd-4fb6-ad1a-01b4ea7be0a2 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:52.643264 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-61e6d362-47a8-4d63-b69d-02f523805df4 req-879923e4-d9fd-4fb6-ad1a-01b4ea7be0a2 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:52.655726 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-61e6d362-47a8-4d63-b69d-02f523805df4 req-879923e4-d9fd-4fb6-ad1a-01b4ea7be0a2 service nova] Creating event network-vif-unplugged:e8ecbe35-34e0-4751-a0e4-9587716eaf81 for instance d490231e-628d-467d-a571-2538c3646f1e on hv-cinder-83009 May 10 03:24:52.661404 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-61e6d362-47a8-4d63-b69d-02f523805df4 req-879923e4-d9fd-4fb6-ad1a-01b4ea7be0a2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035293 May 10 03:24:52.662010 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 416/844] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:52.679349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-1defae17-e521-4f9a-8a4c-d79cfc0d9d6f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:52.688535 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-1defae17-e521-4f9a-8a4c-d79cfc0d9d6f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:52.690285 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-1defae17-e521-4f9a-8a4c-d79cfc0d9d6f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:52.691452 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-1defae17-e521-4f9a-8a4c-d79cfc0d9d6f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1722 microversion: 2.20 time: 0.163599 May 10 03:24:52.693096 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 429/845] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:52 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:52.829563 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-beb9125c-2b09-4441-ad34-549118d0c42c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:52.830585 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-beb9125c-2b09-4441-ad34-549118d0c42c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:52.837356 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-beb9125c-2b09-4441-ad34-549118d0c42c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:52.837811 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-beb9125c-2b09-4441-ad34-549118d0c42c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:52.838587 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-beb9125c-2b09-4441-ad34-549118d0c42c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:52.839024 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-beb9125c-2b09-4441-ad34-549118d0c42c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:52.872138 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-beb9125c-2b09-4441-ad34-549118d0c42c tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046810 May 10 03:24:52.872908 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 417/846] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 03:24:52 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:53.269385 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-1564467f-0ee8-4602-9f4d-74dd6d257898 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:53.273172 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-1564467f-0ee8-4602-9f4d-74dd6d257898 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:53.279882 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1564467f-0ee8-4602-9f4d-74dd6d257898 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:53.284216 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1564467f-0ee8-4602-9f4d-74dd6d257898 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:53.285345 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1564467f-0ee8-4602-9f4d-74dd6d257898 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:53.285950 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1564467f-0ee8-4602-9f4d-74dd6d257898 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:53.483201 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-1564467f-0ee8-4602-9f4d-74dd6d257898 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:53.528512 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-1564467f-0ee8-4602-9f4d-74dd6d257898 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 200 len: 1674 microversion: 2.1 time: 0.262748 May 10 03:24:53.536604 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 430/847] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:53 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 1674 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:24:53.710643 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a9f2ced3-043a-40fa-aa3b-d6de6c377a75 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:53.711533 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-a9f2ced3-043a-40fa-aa3b-d6de6c377a75 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:53.720138 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a9f2ced3-043a-40fa-aa3b-d6de6c377a75 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:53.720713 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a9f2ced3-043a-40fa-aa3b-d6de6c377a75 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:53.721726 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a9f2ced3-043a-40fa-aa3b-d6de6c377a75 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:53.722166 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a9f2ced3-043a-40fa-aa3b-d6de6c377a75 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:53.877530 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-a9f2ced3-043a-40fa-aa3b-d6de6c377a75 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:53.887281 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-319a6867-d0cd-44fc-aa71-85990fbab0c1 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:53.888818 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-319a6867-d0cd-44fc-aa71-85990fbab0c1 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:53.897918 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-319a6867-d0cd-44fc-aa71-85990fbab0c1 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:53.898365 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-319a6867-d0cd-44fc-aa71-85990fbab0c1 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:53.900745 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-319a6867-d0cd-44fc-aa71-85990fbab0c1 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:53.901188 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-319a6867-d0cd-44fc-aa71-85990fbab0c1 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:53.908057 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-a9f2ced3-043a-40fa-aa3b-d6de6c377a75 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:53.909554 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-a9f2ced3-043a-40fa-aa3b-d6de6c377a75 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:53.924678 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-a9f2ced3-043a-40fa-aa3b-d6de6c377a75 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1665 microversion: 2.20 time: 0.204574 May 10 03:24:53.924678 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 418/848] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:53 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1665 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:53.931194 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-01381c68-b2c0-4afe-80de-875cdcbc581a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d9c48ad-754a-475e-ab64-27087cf39b08"}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:24:53.932794 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-01381c68-b2c0-4afe-80de-875cdcbc581a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:53.939145 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-01381c68-b2c0-4afe-80de-875cdcbc581a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:53.939899 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-01381c68-b2c0-4afe-80de-875cdcbc581a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:53.940884 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-01381c68-b2c0-4afe-80de-875cdcbc581a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:53.941558 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-01381c68-b2c0-4afe-80de-875cdcbc581a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:53.948481 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-319a6867-d0cd-44fc-aa71-85990fbab0c1 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065678 May 10 03:24:53.949560 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 431/849] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 10 03:24:53 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:24:54.042634 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-615cff97-3a92-48fe-9bae-3cafe21540c4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:54.043496 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-615cff97-3a92-48fe-9bae-3cafe21540c4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:54.051770 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-615cff97-3a92-48fe-9bae-3cafe21540c4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:54.052544 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-615cff97-3a92-48fe-9bae-3cafe21540c4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:54.053748 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-615cff97-3a92-48fe-9bae-3cafe21540c4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:54.054386 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-615cff97-3a92-48fe-9bae-3cafe21540c4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:54.091193 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-615cff97-3a92-48fe-9bae-3cafe21540c4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Going to try to terminate instance {{(pid=117399) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:24:54.434848 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-615cff97-3a92-48fe-9bae-3cafe21540c4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "DELETE /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827" status: 204 len: 0 microversion: 2.1 time: 0.400934 May 10 03:24:54.436644 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 432/850] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:24:54 2022] DELETE /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 03:24:54.575456 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-c9ef563b-9fe9-40e6-9e44-4c9139955cb6 req-23e63150-0166-4739-8626-9978037dbbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9adf1a01-7c6f-4ad0-8b62-643d71caec83", "name": "network-vif-deleted", "tag": "0f87c033-180b-41b9-bec8-9f6abee088d9"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:24:54.584702 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-c9ef563b-9fe9-40e6-9e44-4c9139955cb6 req-23e63150-0166-4739-8626-9978037dbbb1 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:54.585148 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-c9ef563b-9fe9-40e6-9e44-4c9139955cb6 req-23e63150-0166-4739-8626-9978037dbbb1 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:54.596684 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-c9ef563b-9fe9-40e6-9e44-4c9139955cb6 req-23e63150-0166-4739-8626-9978037dbbb1 service nova] Creating event network-vif-deleted:0f87c033-180b-41b9-bec8-9f6abee088d9 for instance 9adf1a01-7c6f-4ad0-8b62-643d71caec83 on hv-cinder-83009 May 10 03:24:54.601725 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-c9ef563b-9fe9-40e6-9e44-4c9139955cb6 req-23e63150-0166-4739-8626-9978037dbbb1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163574 May 10 03:24:54.602319 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 433/851] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:54.607561 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-2a4dddda-7f0d-4bbc-b544-8efe635678be tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:54.608342 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-2a4dddda-7f0d-4bbc-b544-8efe635678be tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:54.614903 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2a4dddda-7f0d-4bbc-b544-8efe635678be tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:54.615352 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2a4dddda-7f0d-4bbc-b544-8efe635678be tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:54.617190 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2a4dddda-7f0d-4bbc-b544-8efe635678be tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:54.617190 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2a4dddda-7f0d-4bbc-b544-8efe635678be tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:54.762664 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-2a4dddda-7f0d-4bbc-b544-8efe635678be tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:54.771064 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-2a4dddda-7f0d-4bbc-b544-8efe635678be tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827" status: 200 len: 1681 microversion: 2.1 time: 0.167439 May 10 03:24:54.775229 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 434/852] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:54 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:24:54.776792 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a94ad55a-a54e-4d7d-aa22-d5c299db677c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:54.777208 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-a94ad55a-a54e-4d7d-aa22-d5c299db677c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:54.783115 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a94ad55a-a54e-4d7d-aa22-d5c299db677c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:54.783683 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a94ad55a-a54e-4d7d-aa22-d5c299db677c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:54.785118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a94ad55a-a54e-4d7d-aa22-d5c299db677c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:54.785118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a94ad55a-a54e-4d7d-aa22-d5c299db677c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:54.834381 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a94ad55a-a54e-4d7d-aa22-d5c299db677c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:54.834739 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a94ad55a-a54e-4d7d-aa22-d5c299db677c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:54.835232 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.objects.instance [None req-a94ad55a-a54e-4d7d-aa22-d5c299db677c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lazy-loading 'fault' on Instance uuid 9adf1a01-7c6f-4ad0-8b62-643d71caec83 {{(pid=117399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:24:54.888626 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-a94ad55a-a54e-4d7d-aa22-d5c299db677c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:54.896805 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-a94ad55a-a54e-4d7d-aa22-d5c299db677c tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 200 len: 1328 microversion: 2.1 time: 0.124125 May 10 03:24:54.897584 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 435/853] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:54 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 1328 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:24:55.067691 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-01381c68-b2c0-4afe-80de-875cdcbc581a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "POST /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.140604 May 10 03:24:55.068490 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 419/854] 10.222.0.65 () {62 vars in 1363 bytes} [Tue May 10 03:24:53 2022] POST /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e/os-volume_attachments => generated 188 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 03:24:55.193412 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-8da15b1b-d3ac-46b1-98fe-c858ce327340 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:55.193974 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8da15b1b-d3ac-46b1-98fe-c858ce327340 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:55.199872 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8da15b1b-d3ac-46b1-98fe-c858ce327340 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:55.200533 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8da15b1b-d3ac-46b1-98fe-c858ce327340 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:55.201360 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8da15b1b-d3ac-46b1-98fe-c858ce327340 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:55.201796 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8da15b1b-d3ac-46b1-98fe-c858ce327340 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:55.788393 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-34e556ad-c214-4343-8635-336476b046f9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:55.788997 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-34e556ad-c214-4343-8635-336476b046f9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:55.795819 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-34e556ad-c214-4343-8635-336476b046f9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:55.796302 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-34e556ad-c214-4343-8635-336476b046f9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:55.797321 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-34e556ad-c214-4343-8635-336476b046f9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:55.797755 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-34e556ad-c214-4343-8635-336476b046f9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:55.815345 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-8da15b1b-d3ac-46b1-98fe-c858ce327340 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e/os-volume_attachments/0d9c48ad-754a-475e-ab64-27087cf39b08" status: 202 len: 0 microversion: 2.20 time: 0.626441 May 10 03:24:55.816305 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 436/855] 10.222.0.65 () {60 vars in 1456 bytes} [Tue May 10 03:24:55 2022] DELETE /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e/os-volume_attachments/0d9c48ad-754a-475e-ab64-27087cf39b08 => generated 0 bytes in 628 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 03:24:55.880460 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e08b0158-8baa-44fd-9af4-976455ea5af7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:24:55.881182 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-e08b0158-8baa-44fd-9af4-976455ea5af7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:55.887988 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e08b0158-8baa-44fd-9af4-976455ea5af7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:55.888503 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e08b0158-8baa-44fd-9af4-976455ea5af7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:55.889409 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e08b0158-8baa-44fd-9af4-976455ea5af7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:55.889855 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e08b0158-8baa-44fd-9af4-976455ea5af7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:55.931758 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-34e556ad-c214-4343-8635-336476b046f9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:55.939304 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-34e556ad-c214-4343-8635-336476b046f9 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827" status: 200 len: 1681 microversion: 2.1 time: 0.155239 May 10 03:24:55.939964 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 420/856] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:55 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:24:55.951185 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-90454c50-213b-463c-801e-4481650c572e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:55.951185 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-90454c50-213b-463c-801e-4481650c572e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:55.953485 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-90454c50-213b-463c-801e-4481650c572e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:55.953941 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-90454c50-213b-463c-801e-4481650c572e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:55.954726 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-90454c50-213b-463c-801e-4481650c572e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:55.955164 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-90454c50-213b-463c-801e-4481650c572e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:55.986366 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-90454c50-213b-463c-801e-4481650c572e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:55.986819 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-90454c50-213b-463c-801e-4481650c572e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:55.987269 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.objects.instance [None req-90454c50-213b-463c-801e-4481650c572e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lazy-loading 'fault' on Instance uuid 9adf1a01-7c6f-4ad0-8b62-643d71caec83 {{(pid=117400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:24:56.027587 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-90454c50-213b-463c-801e-4481650c572e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14e317d371c4f9f994a568798c00e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '813036cfbb6e4f1b93bbf75a982aa96f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:56.035793 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-90454c50-213b-463c-801e-4481650c572e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 200 len: 1328 microversion: 2.1 time: 0.094244 May 10 03:24:56.036610 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 421/857] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:55 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 1328 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:24:56.069900 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-e08b0158-8baa-44fd-9af4-976455ea5af7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "POST /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e/action" status: 202 len: 0 microversion: 2.20 time: 0.193955 May 10 03:24:56.070663 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 437/858] 10.222.0.65 () {62 vars in 1318 bytes} [Tue May 10 03:24:55 2022] POST /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 10 03:24:56.079251 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-152b0562-92fd-4f94-9dd4-10ca1b587e11 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:56.079876 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-152b0562-92fd-4f94-9dd4-10ca1b587e11 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:56.086269 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-152b0562-92fd-4f94-9dd4-10ca1b587e11 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:56.086911 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-152b0562-92fd-4f94-9dd4-10ca1b587e11 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:56.088036 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-152b0562-92fd-4f94-9dd4-10ca1b587e11 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:56.088632 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-152b0562-92fd-4f94-9dd4-10ca1b587e11 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:56.233296 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-152b0562-92fd-4f94-9dd4-10ca1b587e11 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:56.241885 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-152b0562-92fd-4f94-9dd4-10ca1b587e11 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:56.243393 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-152b0562-92fd-4f94-9dd4-10ca1b587e11 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:56.244589 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-152b0562-92fd-4f94-9dd4-10ca1b587e11 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1673 microversion: 2.20 time: 0.169659 May 10 03:24:56.245162 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 422/859] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:56 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:56.961188 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a4ec69b0-b826-4362-9b53-c9e1eee72480 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:56.961851 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-a4ec69b0-b826-4362-9b53-c9e1eee72480 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:56.968736 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a4ec69b0-b826-4362-9b53-c9e1eee72480 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:56.969389 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a4ec69b0-b826-4362-9b53-c9e1eee72480 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:56.972528 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a4ec69b0-b826-4362-9b53-c9e1eee72480 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:56.975704 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a4ec69b0-b826-4362-9b53-c9e1eee72480 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:57.037671 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-8b19791b-c429-45c5-bb55-d64f6d57fd8f req-27e8623f-852a-42b6-8842-5794322a2e20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87dd0c55-5fe5-4ea8-80f3-fd4af00ad827", "name": "network-vif-deleted", "tag": "af3cf7e3-6eaf-4eb8-97db-23b35c82abb6"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:24:57.050984 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-8b19791b-c429-45c5-bb55-d64f6d57fd8f req-27e8623f-852a-42b6-8842-5794322a2e20 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:57.051429 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-8b19791b-c429-45c5-bb55-d64f6d57fd8f req-27e8623f-852a-42b6-8842-5794322a2e20 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:57.063075 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-8b19791b-c429-45c5-bb55-d64f6d57fd8f req-27e8623f-852a-42b6-8842-5794322a2e20 service nova] Creating event network-vif-deleted:af3cf7e3-6eaf-4eb8-97db-23b35c82abb6 for instance 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 on hv-cinder-83009 May 10 03:24:57.069288 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-8b19791b-c429-45c5-bb55-d64f6d57fd8f req-27e8623f-852a-42b6-8842-5794322a2e20 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035968 May 10 03:24:57.070455 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 423/860] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:24:57.077608 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-322d989e-4f38-4c7f-951d-e025af9c3e91 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:57.081544 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-322d989e-4f38-4c7f-951d-e025af9c3e91 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:57.097488 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-322d989e-4f38-4c7f-951d-e025af9c3e91 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:57.098753 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-322d989e-4f38-4c7f-951d-e025af9c3e91 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:57.100113 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-322d989e-4f38-4c7f-951d-e025af9c3e91 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:57.100773 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-322d989e-4f38-4c7f-951d-e025af9c3e91 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:57.116942 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-322d989e-4f38-4c7f-951d-e025af9c3e91 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] HTTP exception thrown: Instance 9adf1a01-7c6f-4ad0-8b62-643d71caec83 could not be found. May 10 03:24:57.119662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-322d989e-4f38-4c7f-951d-e025af9c3e91 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Request method failure captured: May 10 03:24:57.119662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 HTTP/1.1 May 10 03:24:57.119662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:24:57.119662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:24:57.119662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:24:57.119662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:24:57.119662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:24:57.119662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:24:57.119662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:24:57.119662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:24:57.119662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedmuRgU3yiCt8NQjpf24ZkF33bAoKGS2JnI3LqgS45_z5mYbV5zW2Di09E3_Nka5bvxQvM4XwbD2ES6QrLLzRNe3S9o92uubM0HfeU3XucIN7Voo0fZZ8HPJdkE9P0aPu5HOEN__j9olz-7xp2oxfqFHIDZTUlLR0ZMIGTEUTGrCapc May 10 03:24:57.119662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:24:57.119662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:24:57.119662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:24:57.119662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:24:57.119662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:24:57.119662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:24:57.119662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: 813036cfbb6e4f1b93bbf75a982aa96f May 10 03:24:57.119662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-AttachVolumeTestJSON-1652352797 May 10 03:24:57.119662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:24:57.119662 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:24:57.121923 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_813036cfbb6e4f1b93bbf75a982aa96f", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/813036cfbb6e4f1b93bbf75a982aa96f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/813036cfbb6e4f1b93bbf75a982aa96f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/813036cfbb6e4f1b93bbf75a982aa96f"}]}] May 10 03:24:57.121923 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-AttachVolumeTestJSON-1652352797 May 10 03:24:57.121923 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: 813036cfbb6e4f1b93bbf75a982aa96f May 10 03:24:57.121923 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1652352797 May 10 03:24:57.121923 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-AttachVolumeTestJSON-1652352797-project May 10 03:24:57.121923 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:24:57.121923 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:24:57.121923 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: a14e317d371c4f9f994a568798c00e90 May 10 03:24:57.121923 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-AttachVolumeTestJSON-1652352797-project May 10 03:24:57.121923 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:24:57.121923 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Instance 9adf1a01-7c6f-4ad0-8b62-643d71caec83 could not be found. May 10 03:24:57.121923 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'id': '9adf1a01-7c6f-4ad0-8b62-643d71caec83'} May 10 03:24:57.122783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:24:57.122783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:24:57.122783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:24:57.122783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:24:57.122783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:24:57.122783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:24:57.122783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:24:57.122783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:24:57.122783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:24:57.122783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:24:57.122783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9adf1a01-7c6f-4ad0-8b62-643d71caec83 could not be found. May 10 03:24:57.122783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:57.122783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:24:57.122783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:57.122783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:24:57.122783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:24:57.122783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:24:57.122783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:24:57.122783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:24:57.122783 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:24:57.124328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:24:57.124328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:24:57.124328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:24:57.124328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:24:57.124328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:24:57.124328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:24:57.124328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:24:57.124328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9adf1a01-7c6f-4ad0-8b62-643d71caec83 could not be found. May 10 03:24:57.124328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:57.124328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:24:57.124328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:57.124328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:24:57.124328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:24:57.124328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:24:57.124328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:24:57.124328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:24:57.124328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9adf1a01-7c6f-4ad0-8b62-643d71caec83 could not be found. May 10 03:24:57.124328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:57.127829 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-322d989e-4f38-4c7f-951d-e025af9c3e91 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Returning 404 to user: Instance 9adf1a01-7c6f-4ad0-8b62-643d71caec83 could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:24:57.128906 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-322d989e-4f38-4c7f-951d-e025af9c3e91 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 404 len: 111 microversion: 2.1 time: 0.056875 May 10 03:24:57.129839 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 424/861] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:57 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:24:57.140620 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-a4ec69b0-b826-4362-9b53-c9e1eee72480 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9407e88fdbd74ba196ffd9fd221e15f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7c607953b94c02977d60c0b0536e24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:57.141131 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-11ba83de-2df2-4ed8-8f1d-a04501f0556e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '.version_select at 0x7f6a5d24fe50>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:57.151984 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-a4ec69b0-b826-4362-9b53-c9e1eee72480 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827" status: 200 len: 1615 microversion: 2.1 time: 0.195110 May 10 03:24:57.154887 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 438/862] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:56 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 => generated 1615 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:24:57.214491 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-11ba83de-2df2-4ed8-8f1d-a04501f0556e tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1965655660" status: 202 len: 0 microversion: 2.1 time: 0.078595 May 10 03:24:57.221481 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 425/863] 10.222.0.65 () {58 vars in 1220 bytes} [Tue May 10 03:24:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1965655660 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:24:57.266159 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-9cfadb7b-1063-4d1a-97d2-6f706bbd91ad tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:57.266766 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-9cfadb7b-1063-4d1a-97d2-6f706bbd91ad tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:57.273326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9cfadb7b-1063-4d1a-97d2-6f706bbd91ad tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:57.273784 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9cfadb7b-1063-4d1a-97d2-6f706bbd91ad tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:57.274565 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9cfadb7b-1063-4d1a-97d2-6f706bbd91ad tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:57.275003 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9cfadb7b-1063-4d1a-97d2-6f706bbd91ad tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:57.430110 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-9cfadb7b-1063-4d1a-97d2-6f706bbd91ad tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:57.437945 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-9cfadb7b-1063-4d1a-97d2-6f706bbd91ad tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:57.439474 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-9cfadb7b-1063-4d1a-97d2-6f706bbd91ad tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:57.440669 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-9cfadb7b-1063-4d1a-97d2-6f706bbd91ad tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1673 microversion: 2.20 time: 0.178401 May 10 03:24:57.441234 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 439/864] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:57 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:58.172841 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-ea35a2c0-d7e2-4783-b6d0-6fef835627bf tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:58.174956 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-ea35a2c0-d7e2-4783-b6d0-6fef835627bf tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:58.182609 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ea35a2c0-d7e2-4783-b6d0-6fef835627bf tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:58.183061 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ea35a2c0-d7e2-4783-b6d0-6fef835627bf tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:58.184156 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ea35a2c0-d7e2-4783-b6d0-6fef835627bf tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:58.184647 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ea35a2c0-d7e2-4783-b6d0-6fef835627bf tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:58.199771 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-ea35a2c0-d7e2-4783-b6d0-6fef835627bf tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] HTTP exception thrown: Instance 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 could not be found. May 10 03:24:58.201439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-ea35a2c0-d7e2-4783-b6d0-6fef835627bf tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Request method failure captured: May 10 03:24:58.201439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 HTTP/1.1 May 10 03:24:58.201439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:24:58.201439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:24:58.201439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:24:58.201439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:24:58.201439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:24:58.201439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:24:58.201439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:24:58.201439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:24:58.201439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedm7QRYCgCmNpOHEq-xocEssXcoKFt3Cw-xUSJVkpdbWkcE2a4swkD5OOWo0sIcmaGXBYMa4anhP-9-xwsnmr7TD0HDae0_ZejhV9Z7LARWPFLjL5ozyZp775dsZG_BfqUR5n4ZQlWeOoqrl2-8Sk1TTVheuLGMVx-c_z5Xm6ARd90Q May 10 03:24:58.201439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:24:58.201439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:24:58.201439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:24:58.201439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:24:58.201439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:24:58.201439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:24:58.201439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:24:58.201439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:24:58.201439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:24:58.201439 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:24:58.206183 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b7c607953b94c02977d60c0b0536e24", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b7c607953b94c02977d60c0b0536e24"}]}] May 10 03:24:58.206183 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:24:58.206183 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:24:58.206183 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:24:58.206183 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:24:58.206183 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:24:58.206183 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:24:58.206183 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: 9407e88fdbd74ba196ffd9fd221e15f5 May 10 03:24:58.206183 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:24:58.206183 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:24:58.206183 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Instance 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 could not be found. May 10 03:24:58.206183 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'id': '87dd0c55-5fe5-4ea8-80f3-fd4af00ad827'} May 10 03:24:58.208220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:24:58.208220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:24:58.208220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:24:58.208220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:24:58.208220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:24:58.208220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:24:58.208220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:24:58.208220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:24:58.208220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:24:58.208220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:24:58.208220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 could not be found. May 10 03:24:58.208220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:58.208220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:24:58.208220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:58.208220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:24:58.208220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:24:58.208220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:24:58.208220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:24:58.208220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:24:58.208220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:24:58.209752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:24:58.209752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:24:58.209752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:24:58.209752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:24:58.209752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:24:58.209752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:24:58.209752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:24:58.209752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 could not be found. May 10 03:24:58.209752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:58.209752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:24:58.209752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:58.209752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:24:58.209752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:24:58.209752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:24:58.209752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:24:58.209752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:24:58.209752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 could not be found. May 10 03:24:58.209752 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:24:58.211072 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-ea35a2c0-d7e2-4783-b6d0-6fef835627bf tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Returning 404 to user: Instance 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:24:58.211072 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-ea35a2c0-d7e2-4783-b6d0-6fef835627bf tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827" status: 404 len: 111 microversion: 2.1 time: 0.037134 May 10 03:24:58.211072 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 426/865] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:24:58 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:24:58.212705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-b09b26d3-d543-45bf-95ea-05b083ccdef1 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '.version_select at 0x7f6a62d81ee0>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:58.292407 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-b09b26d3-d543-45bf-95ea-05b083ccdef1 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-873176578" status: 202 len: 0 microversion: 2.1 time: 0.082926 May 10 03:24:58.294475 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 440/866] 10.222.0.65 () {58 vars in 1217 bytes} [Tue May 10 03:24:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-873176578 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:24:58.459509 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-75807f0c-0170-439e-9a56-02437c271434 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:58.460457 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-75807f0c-0170-439e-9a56-02437c271434 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:58.467815 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-75807f0c-0170-439e-9a56-02437c271434 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:58.468313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-75807f0c-0170-439e-9a56-02437c271434 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:58.469079 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-75807f0c-0170-439e-9a56-02437c271434 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:58.469512 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-75807f0c-0170-439e-9a56-02437c271434 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:58.622807 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-75807f0c-0170-439e-9a56-02437c271434 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:58.631641 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-75807f0c-0170-439e-9a56-02437c271434 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:58.634196 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-75807f0c-0170-439e-9a56-02437c271434 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:58.634493 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-75807f0c-0170-439e-9a56-02437c271434 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1731 microversion: 2.20 time: 0.179437 May 10 03:24:58.635034 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 427/867] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:58 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:24:59.653187 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-1f8b85ba-4e09-4809-a9a0-ac87bd990ed8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:24:59.654037 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-1f8b85ba-4e09-4809-a9a0-ac87bd990ed8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:24:59.661213 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1f8b85ba-4e09-4809-a9a0-ac87bd990ed8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:59.661661 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1f8b85ba-4e09-4809-a9a0-ac87bd990ed8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:59.662432 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1f8b85ba-4e09-4809-a9a0-ac87bd990ed8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:24:59.662867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1f8b85ba-4e09-4809-a9a0-ac87bd990ed8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:24:59.823376 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-1f8b85ba-4e09-4809-a9a0-ac87bd990ed8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:59.837662 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-1f8b85ba-4e09-4809-a9a0-ac87bd990ed8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:59.837662 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-1f8b85ba-4e09-4809-a9a0-ac87bd990ed8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:24:59.838799 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-1f8b85ba-4e09-4809-a9a0-ac87bd990ed8 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1731 microversion: 2.20 time: 0.190106 May 10 03:24:59.839858 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 441/868] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:24:59 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:25:00.669132 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-eafa4184-af3c-48f9-b4e7-99fdae65a929 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:00.669787 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-eafa4184-af3c-48f9-b4e7-99fdae65a929 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:00.681681 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-eafa4184-af3c-48f9-b4e7-99fdae65a929 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:00.682533 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-eafa4184-af3c-48f9-b4e7-99fdae65a929 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:00.683565 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-eafa4184-af3c-48f9-b4e7-99fdae65a929 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:00.684479 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-eafa4184-af3c-48f9-b4e7-99fdae65a929 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:00.716739 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-eafa4184-af3c-48f9-b4e7-99fdae65a929 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] HTTP exception thrown: Instance 9adf1a01-7c6f-4ad0-8b62-643d71caec83 could not be found. May 10 03:25:00.722701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-eafa4184-af3c-48f9-b4e7-99fdae65a929 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Request method failure captured: May 10 03:25:00.722701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: DELETE /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 HTTP/1.1 May 10 03:25:00.722701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:25:00.722701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:25:00.722701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:25:00.722701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:25:00.722701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:25:00.722701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:25:00.722701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:25:00.722701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:25:00.722701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedmuRgU3yiCt8NQjpf24ZkF33bAoKGS2JnI3LqgS45_z5mYbV5zW2Di09E3_Nka5bvxQvM4XwbD2ES6QrLLzRNe3S9o92uubM0HfeU3XucIN7Voo0fZZ8HPJdkE9P0aPu5HOEN__j9olz-7xp2oxfqFHIDZTUlLR0ZMIGTEUTGrCapc May 10 03:25:00.722701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:25:00.722701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:25:00.722701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:25:00.722701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:25:00.722701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:25:00.722701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:25:00.722701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: 813036cfbb6e4f1b93bbf75a982aa96f May 10 03:25:00.722701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-AttachVolumeTestJSON-1652352797 May 10 03:25:00.722701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:25:00.722701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:25:00.724334 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_813036cfbb6e4f1b93bbf75a982aa96f", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/813036cfbb6e4f1b93bbf75a982aa96f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/813036cfbb6e4f1b93bbf75a982aa96f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/813036cfbb6e4f1b93bbf75a982aa96f"}]}] May 10 03:25:00.724334 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-AttachVolumeTestJSON-1652352797 May 10 03:25:00.724334 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: 813036cfbb6e4f1b93bbf75a982aa96f May 10 03:25:00.724334 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1652352797 May 10 03:25:00.724334 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-AttachVolumeTestJSON-1652352797-project May 10 03:25:00.724334 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:25:00.724334 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:25:00.724334 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: a14e317d371c4f9f994a568798c00e90 May 10 03:25:00.724334 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-AttachVolumeTestJSON-1652352797-project May 10 03:25:00.724334 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:25:00.724334 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Instance 9adf1a01-7c6f-4ad0-8b62-643d71caec83 could not be found. May 10 03:25:00.724334 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'id': '9adf1a01-7c6f-4ad0-8b62-643d71caec83'} May 10 03:25:00.725363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:25:00.725363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:00.725363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:25:00.725363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:25:00.725363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:25:00.725363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:25:00.725363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:25:00.725363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:25:00.725363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:25:00.725363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:25:00.725363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9adf1a01-7c6f-4ad0-8b62-643d71caec83 could not be found. May 10 03:25:00.725363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:00.725363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:00.725363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:00.725363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:00.725363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:00.725363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:00.725363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:25:00.725363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:25:00.725363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:25:00.727443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:25:00.727443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:25:00.727443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:25:00.727443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:25:00.727443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:25:00.727443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:25:00.727443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:25:00.727443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:25:00.727443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:25:00.727443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9adf1a01-7c6f-4ad0-8b62-643d71caec83 could not be found. May 10 03:25:00.727443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:00.727443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:00.727443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:00.727443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:00.727443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:00.727443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:00.727443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:25:00.727443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:25:00.727443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9adf1a01-7c6f-4ad0-8b62-643d71caec83 could not be found. May 10 03:25:00.727443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:00.728930 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-eafa4184-af3c-48f9-b4e7-99fdae65a929 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Returning 404 to user: Instance 9adf1a01-7c6f-4ad0-8b62-643d71caec83 could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:25:00.728930 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-eafa4184-af3c-48f9-b4e7-99fdae65a929 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 404 len: 111 microversion: 2.1 time: 0.059287 May 10 03:25:00.731853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 428/869] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:25:00 2022] DELETE /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:25:00.739231 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-f41ce9d5-2c39-4146-a213-07f2cbac8370 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:00.740545 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-f41ce9d5-2c39-4146-a213-07f2cbac8370 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 9adf1a01-7c6f-4ad0-8b62-643d71caec83] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:00.750017 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f41ce9d5-2c39-4146-a213-07f2cbac8370 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:00.750759 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f41ce9d5-2c39-4146-a213-07f2cbac8370 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:00.752092 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f41ce9d5-2c39-4146-a213-07f2cbac8370 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:00.753525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f41ce9d5-2c39-4146-a213-07f2cbac8370 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:00.769524 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-f41ce9d5-2c39-4146-a213-07f2cbac8370 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] HTTP exception thrown: Instance 9adf1a01-7c6f-4ad0-8b62-643d71caec83 could not be found. May 10 03:25:00.771715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-f41ce9d5-2c39-4146-a213-07f2cbac8370 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Request method failure captured: May 10 03:25:00.771715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 HTTP/1.1 May 10 03:25:00.771715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:25:00.771715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:25:00.771715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:25:00.771715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:25:00.771715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:25:00.771715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:25:00.771715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:25:00.771715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:25:00.771715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedmuRgU3yiCt8NQjpf24ZkF33bAoKGS2JnI3LqgS45_z5mYbV5zW2Di09E3_Nka5bvxQvM4XwbD2ES6QrLLzRNe3S9o92uubM0HfeU3XucIN7Voo0fZZ8HPJdkE9P0aPu5HOEN__j9olz-7xp2oxfqFHIDZTUlLR0ZMIGTEUTGrCapc May 10 03:25:00.771715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:25:00.771715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:25:00.771715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:25:00.771715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:25:00.771715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:25:00.771715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:25:00.771715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: 813036cfbb6e4f1b93bbf75a982aa96f May 10 03:25:00.771715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-AttachVolumeTestJSON-1652352797 May 10 03:25:00.771715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:25:00.771715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:25:00.773502 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_813036cfbb6e4f1b93bbf75a982aa96f", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/813036cfbb6e4f1b93bbf75a982aa96f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/813036cfbb6e4f1b93bbf75a982aa96f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/813036cfbb6e4f1b93bbf75a982aa96f"}]}] May 10 03:25:00.773502 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-AttachVolumeTestJSON-1652352797 May 10 03:25:00.773502 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: 813036cfbb6e4f1b93bbf75a982aa96f May 10 03:25:00.773502 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1652352797 May 10 03:25:00.773502 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-AttachVolumeTestJSON-1652352797-project May 10 03:25:00.773502 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:25:00.773502 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:25:00.773502 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: a14e317d371c4f9f994a568798c00e90 May 10 03:25:00.773502 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-AttachVolumeTestJSON-1652352797-project May 10 03:25:00.773502 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: > May 10 03:25:00.773502 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Instance 9adf1a01-7c6f-4ad0-8b62-643d71caec83 could not be found. May 10 03:25:00.773502 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': '9adf1a01-7c6f-4ad0-8b62-643d71caec83'} May 10 03:25:00.774525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:25:00.774525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:00.774525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:25:00.774525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:25:00.774525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:25:00.774525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:25:00.774525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:25:00.774525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:25:00.774525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:25:00.774525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:25:00.774525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9adf1a01-7c6f-4ad0-8b62-643d71caec83 could not be found. May 10 03:25:00.774525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:00.774525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:00.774525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:00.774525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:00.774525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:00.774525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:00.774525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:25:00.774525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:25:00.774525 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:25:00.775709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:25:00.775709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:25:00.775709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:25:00.775709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:25:00.775709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:25:00.775709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:25:00.775709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:25:00.775709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9adf1a01-7c6f-4ad0-8b62-643d71caec83 could not be found. May 10 03:25:00.775709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:00.775709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:00.775709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:00.775709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:00.775709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:00.775709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:00.775709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:25:00.775709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:25:00.775709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9adf1a01-7c6f-4ad0-8b62-643d71caec83 could not be found. May 10 03:25:00.775709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:00.776976 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-f41ce9d5-2c39-4146-a213-07f2cbac8370 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Returning 404 to user: Instance 9adf1a01-7c6f-4ad0-8b62-643d71caec83 could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:25:00.776976 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-f41ce9d5-2c39-4146-a213-07f2cbac8370 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83" status: 404 len: 111 microversion: 2.1 time: 0.040455 May 10 03:25:00.776976 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 442/870] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:00 2022] GET /compute/v2.1/servers/9adf1a01-7c6f-4ad0-8b62-643d71caec83 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:25:00.858257 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-ecabd88c-fafa-4bbb-bf97-e863eb9b3f81 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:00.859121 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-ecabd88c-fafa-4bbb-bf97-e863eb9b3f81 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:00.866741 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ecabd88c-fafa-4bbb-bf97-e863eb9b3f81 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:00.867593 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ecabd88c-fafa-4bbb-bf97-e863eb9b3f81 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:00.868692 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ecabd88c-fafa-4bbb-bf97-e863eb9b3f81 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:00.869370 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ecabd88c-fafa-4bbb-bf97-e863eb9b3f81 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:00.924711 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-0f316afc-3e57-4d87-9675-60d76d14a5ff tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:00.927659 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-0f316afc-3e57-4d87-9675-60d76d14a5ff tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:00.938715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0f316afc-3e57-4d87-9675-60d76d14a5ff tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:00.945658 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0f316afc-3e57-4d87-9675-60d76d14a5ff tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:00.945658 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0f316afc-3e57-4d87-9675-60d76d14a5ff tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:00.945658 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0f316afc-3e57-4d87-9675-60d76d14a5ff tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:00.962434 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-0f316afc-3e57-4d87-9675-60d76d14a5ff tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] HTTP exception thrown: Instance 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 could not be found. May 10 03:25:00.974202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-0f316afc-3e57-4d87-9675-60d76d14a5ff tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Request method failure captured: May 10 03:25:00.974202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: DELETE /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 HTTP/1.1 May 10 03:25:00.974202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:25:00.974202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:25:00.974202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:25:00.974202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:25:00.974202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:25:00.974202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:25:00.974202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:25:00.974202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:25:00.974202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedm7QRYCgCmNpOHEq-xocEssXcoKFt3Cw-xUSJVkpdbWkcE2a4swkD5OOWo0sIcmaGXBYMa4anhP-9-xwsnmr7TD0HDae0_ZejhV9Z7LARWPFLjL5ozyZp775dsZG_BfqUR5n4ZQlWeOoqrl2-8Sk1TTVheuLGMVx-c_z5Xm6ARd90Q May 10 03:25:00.974202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:25:00.974202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:25:00.974202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:25:00.974202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:25:00.974202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:25:00.974202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:25:00.974202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:25:00.974202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:00.974202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:25:00.974202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:25:00.975810 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b7c607953b94c02977d60c0b0536e24", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b7c607953b94c02977d60c0b0536e24"}]}] May 10 03:25:00.975810 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:00.975810 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:25:00.975810 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:00.975810 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:25:00.975810 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:25:00.975810 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:25:00.975810 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: 9407e88fdbd74ba196ffd9fd221e15f5 May 10 03:25:00.975810 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:25:00.975810 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: > May 10 03:25:00.975810 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Instance 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 could not be found. May 10 03:25:00.975810 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': '87dd0c55-5fe5-4ea8-80f3-fd4af00ad827'} May 10 03:25:00.976714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:25:00.976714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:00.976714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:25:00.976714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:25:00.976714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:25:00.976714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:25:00.976714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:25:00.976714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:25:00.976714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:25:00.976714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:25:00.976714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 could not be found. May 10 03:25:00.976714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:00.976714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:00.976714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:00.976714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:00.976714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:00.976714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:00.976714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:25:00.976714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:25:00.976714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:25:00.978140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:25:00.978140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:25:00.978140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:25:00.978140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:25:00.978140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:25:00.978140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:25:00.978140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:25:00.978140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:25:00.978140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:25:00.978140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 could not be found. May 10 03:25:00.978140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:00.978140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:00.978140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:00.978140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:00.978140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:00.978140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:00.978140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:25:00.978140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:25:00.978140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 could not be found. May 10 03:25:00.978140 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:00.979602 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-0f316afc-3e57-4d87-9675-60d76d14a5ff tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Returning 404 to user: Instance 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:25:00.979602 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-0f316afc-3e57-4d87-9675-60d76d14a5ff tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "DELETE /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827" status: 404 len: 111 microversion: 2.1 time: 0.064978 May 10 03:25:00.984329 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 443/871] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:25:00 2022] DELETE /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:25:01.001288 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-dc472505-e6f0-4def-9344-407530c1d724 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:01.003193 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-dc472505-e6f0-4def-9344-407530c1d724 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:01.012224 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dc472505-e6f0-4def-9344-407530c1d724 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:01.012746 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dc472505-e6f0-4def-9344-407530c1d724 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:01.013892 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dc472505-e6f0-4def-9344-407530c1d724 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:01.014391 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-dc472505-e6f0-4def-9344-407530c1d724 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:01.032066 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-dc472505-e6f0-4def-9344-407530c1d724 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] HTTP exception thrown: Instance 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 could not be found. May 10 03:25:01.033679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-dc472505-e6f0-4def-9344-407530c1d724 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Request method failure captured: May 10 03:25:01.033679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 HTTP/1.1 May 10 03:25:01.033679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:25:01.033679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:25:01.033679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:25:01.033679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:25:01.033679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:25:01.033679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:25:01.033679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:25:01.033679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:25:01.033679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedm7QRYCgCmNpOHEq-xocEssXcoKFt3Cw-xUSJVkpdbWkcE2a4swkD5OOWo0sIcmaGXBYMa4anhP-9-xwsnmr7TD0HDae0_ZejhV9Z7LARWPFLjL5ozyZp775dsZG_BfqUR5n4ZQlWeOoqrl2-8Sk1TTVheuLGMVx-c_z5Xm6ARd90Q May 10 03:25:01.033679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:25:01.033679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:25:01.033679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:25:01.033679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:25:01.033679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:25:01.033679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:25:01.033679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:25:01.033679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:01.033679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:25:01.033679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:25:01.035247 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b7c607953b94c02977d60c0b0536e24", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b7c607953b94c02977d60c0b0536e24"}]}] May 10 03:25:01.035247 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:01.035247 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:25:01.035247 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:01.035247 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:25:01.035247 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:25:01.035247 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:25:01.035247 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: 9407e88fdbd74ba196ffd9fd221e15f5 May 10 03:25:01.035247 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:25:01.035247 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: > May 10 03:25:01.035247 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Instance 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 could not be found. May 10 03:25:01.035247 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': '87dd0c55-5fe5-4ea8-80f3-fd4af00ad827'} May 10 03:25:01.036913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:25:01.036913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:01.036913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:25:01.036913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:25:01.036913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:25:01.036913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:25:01.036913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:25:01.036913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:25:01.036913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:25:01.036913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:25:01.036913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 could not be found. May 10 03:25:01.036913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:01.036913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:01.036913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:01.036913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:01.036913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:01.036913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:01.036913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:25:01.036913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:25:01.036913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:25:01.038383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:25:01.038383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:25:01.038383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:25:01.038383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:25:01.038383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:25:01.038383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:25:01.038383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:25:01.038383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 could not be found. May 10 03:25:01.038383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:01.038383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:01.038383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:01.038383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:01.038383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:01.038383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:01.038383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:25:01.038383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:25:01.038383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 could not be found. May 10 03:25:01.038383 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:01.040047 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-dc472505-e6f0-4def-9344-407530c1d724 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Returning 404 to user: Instance 87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:25:01.040047 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-dc472505-e6f0-4def-9344-407530c1d724 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827" status: 404 len: 111 microversion: 2.1 time: 0.051524 May 10 03:25:01.040047 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 444/872] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:00 2022] GET /compute/v2.1/servers/87dd0c55-5fe5-4ea8-80f3-fd4af00ad827 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:25:01.153846 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ecabd88c-fafa-4bbb-bf97-e863eb9b3f81 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:01.164933 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ecabd88c-fafa-4bbb-bf97-e863eb9b3f81 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:01.170906 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ecabd88c-fafa-4bbb-bf97-e863eb9b3f81 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:01.175131 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-ecabd88c-fafa-4bbb-bf97-e863eb9b3f81 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1731 microversion: 2.20 time: 0.318003 May 10 03:25:01.175131 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 429/873] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:25:00 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1731 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:25:02.110127 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a977d815-9e51-45ae-9ef4-64e8745ee997 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:02.110645 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-a977d815-9e51-45ae-9ef4-64e8745ee997 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:02.122526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a977d815-9e51-45ae-9ef4-64e8745ee997 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:02.123141 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a977d815-9e51-45ae-9ef4-64e8745ee997 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:02.124215 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a977d815-9e51-45ae-9ef4-64e8745ee997 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:02.124816 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a977d815-9e51-45ae-9ef4-64e8745ee997 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:02.162299 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-a977d815-9e51-45ae-9ef4-64e8745ee997 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] HTTP exception thrown: Instance 1813031a-ba52-4826-9b73-69ae2af70c13 could not be found. May 10 03:25:02.163864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a977d815-9e51-45ae-9ef4-64e8745ee997 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Request method failure captured: May 10 03:25:02.163864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: DELETE /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 HTTP/1.1 May 10 03:25:02.163864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:25:02.163864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:25:02.163864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:25:02.163864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:25:02.163864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:25:02.163864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:25:02.163864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:25:02.163864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:25:02.163864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedmuRgU3yiCt8NQjpf24ZkF33bAoKGS2JnI3LqgS45_z5mYbV5zW2Di09E3_Nka5bvxQvM4XwbD2ES6QrLLzRNe3S9o92uubM0HfeU3XucIN7Voo0fZZ8HPJdkE9P0aPu5HOEN__j9olz-7xp2oxfqFHIDZTUlLR0ZMIGTEUTGrCapc May 10 03:25:02.163864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:25:02.163864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:25:02.163864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:25:02.163864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:25:02.163864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:25:02.163864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:25:02.163864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: 813036cfbb6e4f1b93bbf75a982aa96f May 10 03:25:02.163864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-AttachVolumeTestJSON-1652352797 May 10 03:25:02.163864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:25:02.163864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:25:02.165509 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_813036cfbb6e4f1b93bbf75a982aa96f", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/813036cfbb6e4f1b93bbf75a982aa96f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/813036cfbb6e4f1b93bbf75a982aa96f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/813036cfbb6e4f1b93bbf75a982aa96f"}]}] May 10 03:25:02.165509 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-AttachVolumeTestJSON-1652352797 May 10 03:25:02.165509 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: 813036cfbb6e4f1b93bbf75a982aa96f May 10 03:25:02.165509 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1652352797 May 10 03:25:02.165509 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-AttachVolumeTestJSON-1652352797-project May 10 03:25:02.165509 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:25:02.165509 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:25:02.165509 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: a14e317d371c4f9f994a568798c00e90 May 10 03:25:02.165509 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-AttachVolumeTestJSON-1652352797-project May 10 03:25:02.165509 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: > May 10 03:25:02.165509 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Instance 1813031a-ba52-4826-9b73-69ae2af70c13 could not be found. May 10 03:25:02.165509 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': '1813031a-ba52-4826-9b73-69ae2af70c13'} May 10 03:25:02.166332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:25:02.166332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:02.166332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:25:02.166332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:25:02.166332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:25:02.166332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:25:02.166332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:25:02.166332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:25:02.166332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:25:02.166332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:25:02.166332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1813031a-ba52-4826-9b73-69ae2af70c13 could not be found. May 10 03:25:02.166332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:02.166332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:02.166332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:02.166332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:02.166332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:02.166332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:02.166332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:25:02.166332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:25:02.166332 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:25:02.167764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:25:02.167764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:25:02.167764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:25:02.167764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:25:02.167764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:25:02.167764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:25:02.167764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:25:02.167764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:25:02.167764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:25:02.167764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1813031a-ba52-4826-9b73-69ae2af70c13 could not be found. May 10 03:25:02.167764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:02.167764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:02.167764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:02.167764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:02.167764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:02.167764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:02.167764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:25:02.167764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:25:02.167764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1813031a-ba52-4826-9b73-69ae2af70c13 could not be found. May 10 03:25:02.167764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:02.169165 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a977d815-9e51-45ae-9ef4-64e8745ee997 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Returning 404 to user: Instance 1813031a-ba52-4826-9b73-69ae2af70c13 could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:25:02.169165 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-a977d815-9e51-45ae-9ef4-64e8745ee997 tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "DELETE /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 404 len: 111 microversion: 2.1 time: 0.059214 May 10 03:25:02.169165 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 445/874] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:25:02 2022] DELETE /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:25:02.178343 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-d571ebab-7c89-438b-bba3-f1d04375bf4b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:02.179209 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-d571ebab-7c89-438b-bba3-f1d04375bf4b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] [instance: 1813031a-ba52-4826-9b73-69ae2af70c13] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:02.187602 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d571ebab-7c89-438b-bba3-f1d04375bf4b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:02.188185 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d571ebab-7c89-438b-bba3-f1d04375bf4b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:02.189072 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d571ebab-7c89-438b-bba3-f1d04375bf4b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:02.189676 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d571ebab-7c89-438b-bba3-f1d04375bf4b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:02.190679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-b192c3c0-76cc-4a75-963f-d57c0e45c2f1 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:02.191292 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-b192c3c0-76cc-4a75-963f-d57c0e45c2f1 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:02.197610 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b192c3c0-76cc-4a75-963f-d57c0e45c2f1 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:02.198165 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b192c3c0-76cc-4a75-963f-d57c0e45c2f1 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:02.198903 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b192c3c0-76cc-4a75-963f-d57c0e45c2f1 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:02.199346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b192c3c0-76cc-4a75-963f-d57c0e45c2f1 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:02.205827 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-d571ebab-7c89-438b-bba3-f1d04375bf4b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] HTTP exception thrown: Instance 1813031a-ba52-4826-9b73-69ae2af70c13 could not be found. May 10 03:25:02.208628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-d571ebab-7c89-438b-bba3-f1d04375bf4b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Request method failure captured: May 10 03:25:02.208628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 HTTP/1.1 May 10 03:25:02.208628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:25:02.208628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:25:02.208628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:25:02.208628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:25:02.208628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:25:02.208628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:25:02.208628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:25:02.208628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:25:02.208628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedmuRgU3yiCt8NQjpf24ZkF33bAoKGS2JnI3LqgS45_z5mYbV5zW2Di09E3_Nka5bvxQvM4XwbD2ES6QrLLzRNe3S9o92uubM0HfeU3XucIN7Voo0fZZ8HPJdkE9P0aPu5HOEN__j9olz-7xp2oxfqFHIDZTUlLR0ZMIGTEUTGrCapc May 10 03:25:02.208628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:25:02.208628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:25:02.208628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:25:02.208628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:25:02.208628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:25:02.208628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:25:02.208628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: 813036cfbb6e4f1b93bbf75a982aa96f May 10 03:25:02.208628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-AttachVolumeTestJSON-1652352797 May 10 03:25:02.208628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:25:02.208628 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:25:02.210478 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_813036cfbb6e4f1b93bbf75a982aa96f", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/813036cfbb6e4f1b93bbf75a982aa96f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/813036cfbb6e4f1b93bbf75a982aa96f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/813036cfbb6e4f1b93bbf75a982aa96f"}]}] May 10 03:25:02.210478 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-AttachVolumeTestJSON-1652352797 May 10 03:25:02.210478 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: 813036cfbb6e4f1b93bbf75a982aa96f May 10 03:25:02.210478 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1652352797 May 10 03:25:02.210478 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-AttachVolumeTestJSON-1652352797-project May 10 03:25:02.210478 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:25:02.210478 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:25:02.210478 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: a14e317d371c4f9f994a568798c00e90 May 10 03:25:02.210478 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-AttachVolumeTestJSON-1652352797-project May 10 03:25:02.210478 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:25:02.210478 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Instance 1813031a-ba52-4826-9b73-69ae2af70c13 could not be found. May 10 03:25:02.210478 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'id': '1813031a-ba52-4826-9b73-69ae2af70c13'} May 10 03:25:02.211567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:25:02.211567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:02.211567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:25:02.211567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:25:02.211567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:25:02.211567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:25:02.211567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:25:02.211567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:25:02.211567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:25:02.211567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:25:02.211567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1813031a-ba52-4826-9b73-69ae2af70c13 could not be found. May 10 03:25:02.211567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:02.211567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:02.211567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:02.211567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:02.211567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:02.211567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:02.211567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:25:02.211567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:25:02.211567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:25:02.212778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:25:02.212778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:25:02.212778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:25:02.212778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:25:02.212778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:25:02.212778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:25:02.212778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:25:02.212778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1813031a-ba52-4826-9b73-69ae2af70c13 could not be found. May 10 03:25:02.212778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:02.212778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:02.212778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:02.212778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:02.212778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:02.212778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:02.212778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:25:02.212778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:25:02.212778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1813031a-ba52-4826-9b73-69ae2af70c13 could not be found. May 10 03:25:02.212778 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:02.215150 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-d571ebab-7c89-438b-bba3-f1d04375bf4b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] Returning 404 to user: Instance 1813031a-ba52-4826-9b73-69ae2af70c13 could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:25:02.216472 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-d571ebab-7c89-438b-bba3-f1d04375bf4b tempest-AttachVolumeTestJSON-1652352797 tempest-AttachVolumeTestJSON-1652352797-project] 10.222.0.65 "GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13" status: 404 len: 111 microversion: 2.1 time: 0.043320 May 10 03:25:02.220593 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 430/875] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:02 2022] GET /compute/v2.1/servers/1813031a-ba52-4826-9b73-69ae2af70c13 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:25:02.395381 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-b192c3c0-76cc-4a75-963f-d57c0e45c2f1 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:02.410062 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-b192c3c0-76cc-4a75-963f-d57c0e45c2f1 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:02.413421 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-b192c3c0-76cc-4a75-963f-d57c0e45c2f1 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:02.415413 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-b192c3c0-76cc-4a75-963f-d57c0e45c2f1 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1731 microversion: 2.20 time: 0.228378 May 10 03:25:02.416679 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 446/876] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:25:02 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:25:02.425153 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-333f1120-c115-47d5-80db-673adf96c106 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:02.426030 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-333f1120-c115-47d5-80db-673adf96c106 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:02.436832 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-333f1120-c115-47d5-80db-673adf96c106 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:02.437353 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-333f1120-c115-47d5-80db-673adf96c106 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:02.438157 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-333f1120-c115-47d5-80db-673adf96c106 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:02.438599 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-333f1120-c115-47d5-80db-673adf96c106 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:02.464175 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-333f1120-c115-47d5-80db-673adf96c106 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] HTTP exception thrown: Instance 3c1ceb67-3663-4d21-bf91-ab648bc249e0 could not be found. May 10 03:25:02.466337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-333f1120-c115-47d5-80db-673adf96c106 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Request method failure captured: May 10 03:25:02.466337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: DELETE /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 HTTP/1.1 May 10 03:25:02.466337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:25:02.466337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:25:02.466337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:25:02.466337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:25:02.466337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:25:02.466337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:25:02.466337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:25:02.466337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:25:02.466337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedm7QRYCgCmNpOHEq-xocEssXcoKFt3Cw-xUSJVkpdbWkcE2a4swkD5OOWo0sIcmaGXBYMa4anhP-9-xwsnmr7TD0HDae0_ZejhV9Z7LARWPFLjL5ozyZp775dsZG_BfqUR5n4ZQlWeOoqrl2-8Sk1TTVheuLGMVx-c_z5Xm6ARd90Q May 10 03:25:02.466337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:25:02.466337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:25:02.466337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:25:02.466337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:25:02.466337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:25:02.466337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:25:02.466337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:25:02.466337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:02.466337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:25:02.466337 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:25:02.468417 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b7c607953b94c02977d60c0b0536e24", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b7c607953b94c02977d60c0b0536e24"}]}] May 10 03:25:02.468417 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:02.468417 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:25:02.468417 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:02.468417 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:25:02.468417 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:25:02.468417 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:25:02.468417 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: 9407e88fdbd74ba196ffd9fd221e15f5 May 10 03:25:02.468417 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:25:02.468417 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:25:02.468417 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Instance 3c1ceb67-3663-4d21-bf91-ab648bc249e0 could not be found. May 10 03:25:02.468417 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'id': '3c1ceb67-3663-4d21-bf91-ab648bc249e0'} May 10 03:25:02.469442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:25:02.469442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:02.469442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:25:02.469442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:25:02.469442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:25:02.469442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:25:02.469442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:25:02.469442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:25:02.469442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:25:02.469442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:25:02.469442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c1ceb67-3663-4d21-bf91-ab648bc249e0 could not be found. May 10 03:25:02.469442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:02.469442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:02.469442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:02.469442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:02.469442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:02.469442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:02.469442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:25:02.469442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:25:02.469442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:25:02.471043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:25:02.471043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:25:02.471043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:25:02.471043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:25:02.471043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:25:02.471043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:25:02.471043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:25:02.471043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:25:02.471043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:25:02.471043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c1ceb67-3663-4d21-bf91-ab648bc249e0 could not be found. May 10 03:25:02.471043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:02.471043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:02.471043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:02.471043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:02.471043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:02.471043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:02.471043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:25:02.471043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:25:02.471043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c1ceb67-3663-4d21-bf91-ab648bc249e0 could not be found. May 10 03:25:02.471043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:02.473451 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-333f1120-c115-47d5-80db-673adf96c106 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Returning 404 to user: Instance 3c1ceb67-3663-4d21-bf91-ab648bc249e0 could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:25:02.474420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-333f1120-c115-47d5-80db-673adf96c106 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0" status: 404 len: 111 microversion: 2.1 time: 0.055022 May 10 03:25:02.475265 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 431/877] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:25:02 2022] DELETE /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:25:02.489013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c3b66fc1-2a99-4d57-b5b4-ce0d6cd8c239 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:02.490368 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-c3b66fc1-2a99-4d57-b5b4-ce0d6cd8c239 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 3c1ceb67-3663-4d21-bf91-ab648bc249e0] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:02.501420 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c3b66fc1-2a99-4d57-b5b4-ce0d6cd8c239 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:02.503261 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c3b66fc1-2a99-4d57-b5b4-ce0d6cd8c239 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:02.505064 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c3b66fc1-2a99-4d57-b5b4-ce0d6cd8c239 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:02.505936 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c3b66fc1-2a99-4d57-b5b4-ce0d6cd8c239 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:02.527832 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-c3b66fc1-2a99-4d57-b5b4-ce0d6cd8c239 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] HTTP exception thrown: Instance 3c1ceb67-3663-4d21-bf91-ab648bc249e0 could not be found. May 10 03:25:02.530219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c3b66fc1-2a99-4d57-b5b4-ce0d6cd8c239 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Request method failure captured: May 10 03:25:02.530219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 HTTP/1.1 May 10 03:25:02.530219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:25:02.530219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:25:02.530219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:25:02.530219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:25:02.530219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:25:02.530219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:25:02.530219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:25:02.530219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:25:02.530219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedm7QRYCgCmNpOHEq-xocEssXcoKFt3Cw-xUSJVkpdbWkcE2a4swkD5OOWo0sIcmaGXBYMa4anhP-9-xwsnmr7TD0HDae0_ZejhV9Z7LARWPFLjL5ozyZp775dsZG_BfqUR5n4ZQlWeOoqrl2-8Sk1TTVheuLGMVx-c_z5Xm6ARd90Q May 10 03:25:02.530219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:25:02.530219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:25:02.530219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:25:02.530219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:25:02.530219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:25:02.530219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:25:02.530219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:25:02.530219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:02.530219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:25:02.530219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:25:02.531641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b7c607953b94c02977d60c0b0536e24", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b7c607953b94c02977d60c0b0536e24"}]}] May 10 03:25:02.531641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:02.531641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:25:02.531641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:02.531641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:25:02.531641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:25:02.531641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:25:02.531641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: 9407e88fdbd74ba196ffd9fd221e15f5 May 10 03:25:02.531641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:25:02.531641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: > May 10 03:25:02.531641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Instance 3c1ceb67-3663-4d21-bf91-ab648bc249e0 could not be found. May 10 03:25:02.531641 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': '3c1ceb67-3663-4d21-bf91-ab648bc249e0'} May 10 03:25:02.532631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:25:02.532631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:02.532631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:25:02.532631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:25:02.532631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:25:02.532631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:25:02.532631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:25:02.532631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:25:02.532631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:25:02.532631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:25:02.532631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c1ceb67-3663-4d21-bf91-ab648bc249e0 could not be found. May 10 03:25:02.532631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:02.532631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:02.532631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:02.532631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:02.532631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:02.532631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:02.532631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:25:02.532631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:25:02.532631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:25:02.533949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:25:02.533949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:25:02.533949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:25:02.533949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:25:02.533949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:25:02.533949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:25:02.533949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:25:02.533949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c1ceb67-3663-4d21-bf91-ab648bc249e0 could not be found. May 10 03:25:02.533949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:02.533949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:02.533949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:02.533949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:02.533949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:02.533949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:02.533949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:25:02.533949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:25:02.533949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c1ceb67-3663-4d21-bf91-ab648bc249e0 could not be found. May 10 03:25:02.533949 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:02.541493 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c3b66fc1-2a99-4d57-b5b4-ce0d6cd8c239 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Returning 404 to user: Instance 3c1ceb67-3663-4d21-bf91-ab648bc249e0 could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:25:02.542644 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-c3b66fc1-2a99-4d57-b5b4-ce0d6cd8c239 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0" status: 404 len: 111 microversion: 2.1 time: 0.063454 May 10 03:25:02.543693 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 447/878] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:02 2022] GET /compute/v2.1/servers/3c1ceb67-3663-4d21-bf91-ab648bc249e0 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 03:25:02.551882 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-739d7bfa-09d4-46e1-a6a8-f62469ff24e4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:02.552412 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-739d7bfa-09d4-46e1-a6a8-f62469ff24e4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:02.563501 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-739d7bfa-09d4-46e1-a6a8-f62469ff24e4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:02.563876 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-739d7bfa-09d4-46e1-a6a8-f62469ff24e4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:02.564702 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-739d7bfa-09d4-46e1-a6a8-f62469ff24e4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:02.565149 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-739d7bfa-09d4-46e1-a6a8-f62469ff24e4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:02.594111 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-739d7bfa-09d4-46e1-a6a8-f62469ff24e4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] HTTP exception thrown: Instance 25e932f1-fc8d-4515-b33f-e1ba788e850b could not be found. May 10 03:25:02.602287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-739d7bfa-09d4-46e1-a6a8-f62469ff24e4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Request method failure captured: May 10 03:25:02.602287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: DELETE /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b HTTP/1.1 May 10 03:25:02.602287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:25:02.602287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:25:02.602287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:25:02.602287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:25:02.602287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:25:02.602287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:25:02.602287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:25:02.602287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:25:02.602287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedm7QRYCgCmNpOHEq-xocEssXcoKFt3Cw-xUSJVkpdbWkcE2a4swkD5OOWo0sIcmaGXBYMa4anhP-9-xwsnmr7TD0HDae0_ZejhV9Z7LARWPFLjL5ozyZp775dsZG_BfqUR5n4ZQlWeOoqrl2-8Sk1TTVheuLGMVx-c_z5Xm6ARd90Q May 10 03:25:02.602287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:25:02.602287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:25:02.602287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:25:02.602287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:25:02.602287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:25:02.602287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:25:02.602287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:25:02.602287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:02.602287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:25:02.602287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:25:02.604165 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b7c607953b94c02977d60c0b0536e24", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b7c607953b94c02977d60c0b0536e24"}]}] May 10 03:25:02.604165 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:02.604165 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:25:02.604165 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:02.604165 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:25:02.604165 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:25:02.604165 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:25:02.604165 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: 9407e88fdbd74ba196ffd9fd221e15f5 May 10 03:25:02.604165 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:25:02.604165 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:25:02.604165 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Instance 25e932f1-fc8d-4515-b33f-e1ba788e850b could not be found. May 10 03:25:02.604165 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'id': '25e932f1-fc8d-4515-b33f-e1ba788e850b'} May 10 03:25:02.605028 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:25:02.605028 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:02.605028 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:25:02.605028 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:25:02.605028 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:25:02.605028 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:25:02.605028 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:25:02.605028 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:25:02.605028 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:25:02.605028 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:25:02.605028 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25e932f1-fc8d-4515-b33f-e1ba788e850b could not be found. May 10 03:25:02.605028 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:02.605028 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:02.605028 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:02.605028 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:02.605028 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:02.605028 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:02.605028 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:25:02.605028 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:25:02.605028 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:25:02.606446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:25:02.606446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:25:02.606446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:25:02.606446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:25:02.606446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:25:02.606446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:25:02.606446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:25:02.606446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:25:02.606446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:25:02.606446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25e932f1-fc8d-4515-b33f-e1ba788e850b could not be found. May 10 03:25:02.606446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:02.606446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:02.606446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:02.606446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:02.606446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:02.606446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:02.606446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:25:02.606446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:25:02.606446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25e932f1-fc8d-4515-b33f-e1ba788e850b could not be found. May 10 03:25:02.606446 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:02.607863 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-739d7bfa-09d4-46e1-a6a8-f62469ff24e4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Returning 404 to user: Instance 25e932f1-fc8d-4515-b33f-e1ba788e850b could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:25:02.607863 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-739d7bfa-09d4-46e1-a6a8-f62469ff24e4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "DELETE /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 404 len: 111 microversion: 2.1 time: 0.058101 May 10 03:25:02.609558 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 432/879] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:25:02 2022] DELETE /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:25:02.622613 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ba9ba525-efdd-4f68-a4ee-2bd0254cc2ff tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:02.623369 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ba9ba525-efdd-4f68-a4ee-2bd0254cc2ff tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: 25e932f1-fc8d-4515-b33f-e1ba788e850b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:02.630775 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ba9ba525-efdd-4f68-a4ee-2bd0254cc2ff tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:02.631663 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ba9ba525-efdd-4f68-a4ee-2bd0254cc2ff tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:02.632826 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ba9ba525-efdd-4f68-a4ee-2bd0254cc2ff tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:02.633570 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ba9ba525-efdd-4f68-a4ee-2bd0254cc2ff tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:02.650552 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-ba9ba525-efdd-4f68-a4ee-2bd0254cc2ff tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] HTTP exception thrown: Instance 25e932f1-fc8d-4515-b33f-e1ba788e850b could not be found. May 10 03:25:02.652867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ba9ba525-efdd-4f68-a4ee-2bd0254cc2ff tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Request method failure captured: May 10 03:25:02.652867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b HTTP/1.1 May 10 03:25:02.652867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:25:02.652867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:25:02.652867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:25:02.652867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:25:02.652867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:25:02.652867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:25:02.652867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:25:02.652867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:25:02.652867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedm7QRYCgCmNpOHEq-xocEssXcoKFt3Cw-xUSJVkpdbWkcE2a4swkD5OOWo0sIcmaGXBYMa4anhP-9-xwsnmr7TD0HDae0_ZejhV9Z7LARWPFLjL5ozyZp775dsZG_BfqUR5n4ZQlWeOoqrl2-8Sk1TTVheuLGMVx-c_z5Xm6ARd90Q May 10 03:25:02.652867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:25:02.652867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:25:02.652867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:25:02.652867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:25:02.652867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:25:02.652867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:25:02.652867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:25:02.652867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:02.652867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:25:02.652867 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:25:02.654783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b7c607953b94c02977d60c0b0536e24", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b7c607953b94c02977d60c0b0536e24"}]}] May 10 03:25:02.654783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:02.654783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:25:02.654783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:02.654783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:25:02.654783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:25:02.654783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:25:02.654783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: 9407e88fdbd74ba196ffd9fd221e15f5 May 10 03:25:02.654783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:25:02.654783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: > May 10 03:25:02.654783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Instance 25e932f1-fc8d-4515-b33f-e1ba788e850b could not be found. May 10 03:25:02.654783 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': '25e932f1-fc8d-4515-b33f-e1ba788e850b'} May 10 03:25:02.655687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:25:02.655687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:02.655687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:25:02.655687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:25:02.655687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:25:02.655687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:25:02.655687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:25:02.655687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:25:02.655687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:25:02.655687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:25:02.655687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25e932f1-fc8d-4515-b33f-e1ba788e850b could not be found. May 10 03:25:02.655687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:02.655687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:02.655687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:02.655687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:02.655687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:02.655687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:02.655687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:25:02.655687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:25:02.655687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:25:02.657296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:25:02.657296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:25:02.657296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:25:02.657296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:25:02.657296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:25:02.657296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:25:02.657296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:25:02.657296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25e932f1-fc8d-4515-b33f-e1ba788e850b could not be found. May 10 03:25:02.657296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:02.657296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:02.657296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:02.657296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:02.657296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:02.657296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:02.657296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:25:02.657296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:25:02.657296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25e932f1-fc8d-4515-b33f-e1ba788e850b could not be found. May 10 03:25:02.657296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:02.659665 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ba9ba525-efdd-4f68-a4ee-2bd0254cc2ff tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Returning 404 to user: Instance 25e932f1-fc8d-4515-b33f-e1ba788e850b could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:25:02.660991 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ba9ba525-efdd-4f68-a4ee-2bd0254cc2ff tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b" status: 404 len: 111 microversion: 2.1 time: 0.042464 May 10 03:25:02.661730 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 448/880] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:02 2022] GET /compute/v2.1/servers/25e932f1-fc8d-4515-b33f-e1ba788e850b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:25:03.436389 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-04fb7fdd-25c7-43ac-9ea7-d005d3f0ec76 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:03.437050 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-04fb7fdd-25c7-43ac-9ea7-d005d3f0ec76 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:03.445290 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-04fb7fdd-25c7-43ac-9ea7-d005d3f0ec76 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:03.445739 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-04fb7fdd-25c7-43ac-9ea7-d005d3f0ec76 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:03.448646 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-04fb7fdd-25c7-43ac-9ea7-d005d3f0ec76 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:03.448646 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-04fb7fdd-25c7-43ac-9ea7-d005d3f0ec76 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:03.605103 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-04fb7fdd-25c7-43ac-9ea7-d005d3f0ec76 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:03.614427 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-04fb7fdd-25c7-43ac-9ea7-d005d3f0ec76 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:03.616230 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-04fb7fdd-25c7-43ac-9ea7-d005d3f0ec76 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:03.617668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-04fb7fdd-25c7-43ac-9ea7-d005d3f0ec76 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1731 microversion: 2.20 time: 0.187203 May 10 03:25:03.618585 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 433/881] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:25:03 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:25:04.009535 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-7cf3ca26-f5e5-4f1e-9209-7a9c3a3544c4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:04.014125 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-7cf3ca26-f5e5-4f1e-9209-7a9c3a3544c4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:04.025262 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7cf3ca26-f5e5-4f1e-9209-7a9c3a3544c4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:04.029330 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7cf3ca26-f5e5-4f1e-9209-7a9c3a3544c4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:04.030412 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7cf3ca26-f5e5-4f1e-9209-7a9c3a3544c4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:04.031471 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-7cf3ca26-f5e5-4f1e-9209-7a9c3a3544c4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:04.054359 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-7cf3ca26-f5e5-4f1e-9209-7a9c3a3544c4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] HTTP exception thrown: Instance a275173c-51a6-4cc6-aef2-b30bcee8b67b could not be found. May 10 03:25:04.055931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-7cf3ca26-f5e5-4f1e-9209-7a9c3a3544c4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Request method failure captured: May 10 03:25:04.055931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: DELETE /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b HTTP/1.1 May 10 03:25:04.055931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:25:04.055931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:25:04.055931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:25:04.055931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:25:04.055931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:25:04.055931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:25:04.055931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:25:04.055931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:25:04.055931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedm7QRYCgCmNpOHEq-xocEssXcoKFt3Cw-xUSJVkpdbWkcE2a4swkD5OOWo0sIcmaGXBYMa4anhP-9-xwsnmr7TD0HDae0_ZejhV9Z7LARWPFLjL5ozyZp775dsZG_BfqUR5n4ZQlWeOoqrl2-8Sk1TTVheuLGMVx-c_z5Xm6ARd90Q May 10 03:25:04.055931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:25:04.055931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:25:04.055931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:25:04.055931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:25:04.055931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:25:04.055931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:25:04.055931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:25:04.055931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:04.055931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:25:04.055931 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:25:04.057558 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b7c607953b94c02977d60c0b0536e24", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b7c607953b94c02977d60c0b0536e24"}]}] May 10 03:25:04.057558 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:04.057558 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:25:04.057558 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:04.057558 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:25:04.057558 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:25:04.057558 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:25:04.057558 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: 9407e88fdbd74ba196ffd9fd221e15f5 May 10 03:25:04.057558 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:25:04.057558 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: > May 10 03:25:04.057558 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Instance a275173c-51a6-4cc6-aef2-b30bcee8b67b could not be found. May 10 03:25:04.057558 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': 'a275173c-51a6-4cc6-aef2-b30bcee8b67b'} May 10 03:25:04.060726 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:25:04.060726 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:04.060726 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:25:04.060726 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:25:04.060726 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:25:04.060726 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:25:04.060726 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:25:04.060726 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:25:04.060726 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:25:04.060726 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:25:04.060726 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a275173c-51a6-4cc6-aef2-b30bcee8b67b could not be found. May 10 03:25:04.060726 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:04.060726 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:04.060726 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:04.060726 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:04.060726 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:04.060726 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:04.060726 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:25:04.060726 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:25:04.060726 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:25:04.062138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:25:04.062138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:25:04.062138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:25:04.062138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:25:04.062138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:25:04.062138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:25:04.062138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:25:04.062138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:25:04.062138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:25:04.062138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a275173c-51a6-4cc6-aef2-b30bcee8b67b could not be found. May 10 03:25:04.062138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:04.062138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:04.062138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:04.062138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:04.062138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:04.062138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:04.062138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:25:04.062138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:25:04.062138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a275173c-51a6-4cc6-aef2-b30bcee8b67b could not be found. May 10 03:25:04.062138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:04.063779 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-7cf3ca26-f5e5-4f1e-9209-7a9c3a3544c4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Returning 404 to user: Instance a275173c-51a6-4cc6-aef2-b30bcee8b67b could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:25:04.063779 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-7cf3ca26-f5e5-4f1e-9209-7a9c3a3544c4 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 404 len: 111 microversion: 2.1 time: 0.057893 May 10 03:25:04.063779 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 449/882] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:25:03 2022] DELETE /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:25:04.066370 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-e43feb42-a18e-4eac-b69f-23fe38dff232 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:04.067525 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-e43feb42-a18e-4eac-b69f-23fe38dff232 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] [instance: a275173c-51a6-4cc6-aef2-b30bcee8b67b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:04.074622 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e43feb42-a18e-4eac-b69f-23fe38dff232 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:04.075177 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e43feb42-a18e-4eac-b69f-23fe38dff232 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:04.075897 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e43feb42-a18e-4eac-b69f-23fe38dff232 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:04.076394 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e43feb42-a18e-4eac-b69f-23fe38dff232 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:04.092687 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-e43feb42-a18e-4eac-b69f-23fe38dff232 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] HTTP exception thrown: Instance a275173c-51a6-4cc6-aef2-b30bcee8b67b could not be found. May 10 03:25:04.094591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-e43feb42-a18e-4eac-b69f-23fe38dff232 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Request method failure captured: May 10 03:25:04.094591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b HTTP/1.1 May 10 03:25:04.094591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:25:04.094591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:25:04.094591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:25:04.094591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:25:04.094591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:25:04.094591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:25:04.094591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:25:04.094591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:25:04.094591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedm7QRYCgCmNpOHEq-xocEssXcoKFt3Cw-xUSJVkpdbWkcE2a4swkD5OOWo0sIcmaGXBYMa4anhP-9-xwsnmr7TD0HDae0_ZejhV9Z7LARWPFLjL5ozyZp775dsZG_BfqUR5n4ZQlWeOoqrl2-8Sk1TTVheuLGMVx-c_z5Xm6ARd90Q May 10 03:25:04.094591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:25:04.094591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:25:04.094591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:25:04.094591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:25:04.094591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:25:04.094591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:25:04.094591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:25:04.094591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:04.094591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:25:04.094591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:25:04.096287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b7c607953b94c02977d60c0b0536e24", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b7c607953b94c02977d60c0b0536e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b7c607953b94c02977d60c0b0536e24"}]}] May 10 03:25:04.096287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:04.096287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: 0b7c607953b94c02977d60c0b0536e24 May 10 03:25:04.096287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017430842 May 10 03:25:04.096287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:25:04.096287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:25:04.096287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:25:04.096287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: 9407e88fdbd74ba196ffd9fd221e15f5 May 10 03:25:04.096287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-AttachVolumeNegativeTest-1017430842-project May 10 03:25:04.096287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:25:04.096287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Instance a275173c-51a6-4cc6-aef2-b30bcee8b67b could not be found. May 10 03:25:04.096287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'id': 'a275173c-51a6-4cc6-aef2-b30bcee8b67b'} May 10 03:25:04.097169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:25:04.097169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:04.097169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:25:04.097169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:25:04.097169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:25:04.097169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:25:04.097169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:25:04.097169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:25:04.097169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:25:04.097169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:25:04.097169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a275173c-51a6-4cc6-aef2-b30bcee8b67b could not be found. May 10 03:25:04.097169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:04.097169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:04.097169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:04.097169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:04.097169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:04.097169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:04.097169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:25:04.097169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:25:04.097169 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:25:04.098648 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:25:04.098648 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:25:04.098648 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:25:04.098648 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:25:04.098648 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:25:04.098648 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:25:04.098648 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:25:04.098648 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a275173c-51a6-4cc6-aef2-b30bcee8b67b could not be found. May 10 03:25:04.098648 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:04.098648 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:04.098648 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:04.098648 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:04.098648 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:04.098648 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:04.098648 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:25:04.098648 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:25:04.098648 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a275173c-51a6-4cc6-aef2-b30bcee8b67b could not be found. May 10 03:25:04.098648 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:04.103037 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-e43feb42-a18e-4eac-b69f-23fe38dff232 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] Returning 404 to user: Instance a275173c-51a6-4cc6-aef2-b30bcee8b67b could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:25:04.104269 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-e43feb42-a18e-4eac-b69f-23fe38dff232 tempest-AttachVolumeNegativeTest-1017430842 tempest-AttachVolumeNegativeTest-1017430842-project] 10.222.0.65 "GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b" status: 404 len: 111 microversion: 2.1 time: 0.041875 May 10 03:25:04.105003 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 434/883] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:04 2022] GET /compute/v2.1/servers/a275173c-51a6-4cc6-aef2-b30bcee8b67b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 03:25:04.640153 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-1d6714c6-be37-4c9b-ad6e-625b50b7d6b5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:04.641110 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-1d6714c6-be37-4c9b-ad6e-625b50b7d6b5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:04.658306 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1d6714c6-be37-4c9b-ad6e-625b50b7d6b5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:04.659087 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1d6714c6-be37-4c9b-ad6e-625b50b7d6b5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:04.665115 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1d6714c6-be37-4c9b-ad6e-625b50b7d6b5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:04.666368 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1d6714c6-be37-4c9b-ad6e-625b50b7d6b5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:05.138199 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-1d6714c6-be37-4c9b-ad6e-625b50b7d6b5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:05.150145 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-1d6714c6-be37-4c9b-ad6e-625b50b7d6b5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:05.154865 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-1d6714c6-be37-4c9b-ad6e-625b50b7d6b5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:05.160230 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-1d6714c6-be37-4c9b-ad6e-625b50b7d6b5 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1731 microversion: 2.20 time: 0.524523 May 10 03:25:05.167135 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 450/884] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:25:04 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1731 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:25:06.211674 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-609f3fdf-e914-4c8a-aa3b-460ef40a4cdf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:06.212427 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-609f3fdf-e914-4c8a-aa3b-460ef40a4cdf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:06.219949 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-609f3fdf-e914-4c8a-aa3b-460ef40a4cdf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:06.220769 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-609f3fdf-e914-4c8a-aa3b-460ef40a4cdf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:06.221576 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-609f3fdf-e914-4c8a-aa3b-460ef40a4cdf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:06.222018 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-609f3fdf-e914-4c8a-aa3b-460ef40a4cdf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:06.617543 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-609f3fdf-e914-4c8a-aa3b-460ef40a4cdf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:06.631168 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-609f3fdf-e914-4c8a-aa3b-460ef40a4cdf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:06.633886 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-609f3fdf-e914-4c8a-aa3b-460ef40a4cdf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:06.635438 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-609f3fdf-e914-4c8a-aa3b-460ef40a4cdf tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1731 microversion: 2.20 time: 0.428601 May 10 03:25:06.636576 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 435/885] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:25:06 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1731 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:25:07.655508 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-323f73d9-9cff-4f9e-a551-b2871909cbfc tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:07.656758 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-323f73d9-9cff-4f9e-a551-b2871909cbfc tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:07.664873 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-323f73d9-9cff-4f9e-a551-b2871909cbfc tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:07.665882 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-323f73d9-9cff-4f9e-a551-b2871909cbfc tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:07.666886 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-323f73d9-9cff-4f9e-a551-b2871909cbfc tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:07.667513 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-323f73d9-9cff-4f9e-a551-b2871909cbfc tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:07.962980 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-323f73d9-9cff-4f9e-a551-b2871909cbfc tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:07.980069 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-323f73d9-9cff-4f9e-a551-b2871909cbfc tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:07.988534 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-323f73d9-9cff-4f9e-a551-b2871909cbfc tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:07.995843 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-323f73d9-9cff-4f9e-a551-b2871909cbfc tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1731 microversion: 2.20 time: 0.339028 May 10 03:25:07.995843 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 451/886] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:25:07 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1731 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:25:09.015737 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-216a3276-b835-4876-90e4-f082f8403d15 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:09.016476 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-216a3276-b835-4876-90e4-f082f8403d15 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:09.026214 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-216a3276-b835-4876-90e4-f082f8403d15 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:09.026970 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-216a3276-b835-4876-90e4-f082f8403d15 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:09.027947 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-216a3276-b835-4876-90e4-f082f8403d15 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:09.028399 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-216a3276-b835-4876-90e4-f082f8403d15 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:09.304074 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-216a3276-b835-4876-90e4-f082f8403d15 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:09.310360 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-216a3276-b835-4876-90e4-f082f8403d15 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:09.312142 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-216a3276-b835-4876-90e4-f082f8403d15 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:09.313870 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-216a3276-b835-4876-90e4-f082f8403d15 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1731 microversion: 2.20 time: 0.301972 May 10 03:25:09.325240 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 436/887] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:25:09 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1731 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 03:25:10.333962 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-903c8cf6-005d-437a-8c74-3f274da2201c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:10.334566 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-903c8cf6-005d-437a-8c74-3f274da2201c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:10.341582 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-903c8cf6-005d-437a-8c74-3f274da2201c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:10.342236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-903c8cf6-005d-437a-8c74-3f274da2201c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:10.343179 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-903c8cf6-005d-437a-8c74-3f274da2201c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:10.343615 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-903c8cf6-005d-437a-8c74-3f274da2201c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:10.504925 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-903c8cf6-005d-437a-8c74-3f274da2201c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:10.512516 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-903c8cf6-005d-437a-8c74-3f274da2201c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:10.515376 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-903c8cf6-005d-437a-8c74-3f274da2201c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:10.515376 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-903c8cf6-005d-437a-8c74-3f274da2201c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1731 microversion: 2.20 time: 0.186125 May 10 03:25:10.516364 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 452/888] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:25:10 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:25:11.532862 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-0b2c9a4c-bf5b-4fdc-8e4a-271b8a30485c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:11.533473 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-0b2c9a4c-bf5b-4fdc-8e4a-271b8a30485c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:11.540520 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0b2c9a4c-bf5b-4fdc-8e4a-271b8a30485c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:11.540975 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0b2c9a4c-bf5b-4fdc-8e4a-271b8a30485c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:11.541743 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0b2c9a4c-bf5b-4fdc-8e4a-271b8a30485c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:11.542185 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0b2c9a4c-bf5b-4fdc-8e4a-271b8a30485c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:11.689482 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-0b2c9a4c-bf5b-4fdc-8e4a-271b8a30485c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:11.699356 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-0b2c9a4c-bf5b-4fdc-8e4a-271b8a30485c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:11.701407 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-0b2c9a4c-bf5b-4fdc-8e4a-271b8a30485c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:11.703294 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-0b2c9a4c-bf5b-4fdc-8e4a-271b8a30485c tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1731 microversion: 2.20 time: 0.174267 May 10 03:25:11.704791 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 437/889] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:25:11 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:25:12.723208 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-788825b0-d1a2-4ac9-92ed-87a02b68fded tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:12.724804 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-788825b0-d1a2-4ac9-92ed-87a02b68fded tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:12.733715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-788825b0-d1a2-4ac9-92ed-87a02b68fded tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:12.734456 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-788825b0-d1a2-4ac9-92ed-87a02b68fded tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:12.736353 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-788825b0-d1a2-4ac9-92ed-87a02b68fded tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:12.737714 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-788825b0-d1a2-4ac9-92ed-87a02b68fded tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:12.878504 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-788825b0-d1a2-4ac9-92ed-87a02b68fded tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:12.888862 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-788825b0-d1a2-4ac9-92ed-87a02b68fded tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:12.890812 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-788825b0-d1a2-4ac9-92ed-87a02b68fded tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:12.892944 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-788825b0-d1a2-4ac9-92ed-87a02b68fded tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1731 microversion: 2.20 time: 0.174397 May 10 03:25:12.893976 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 453/890] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:25:12 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:25:13.911925 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-66658d3c-80f7-414c-aeb8-dfec68746d0d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:13.912715 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-66658d3c-80f7-414c-aeb8-dfec68746d0d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:13.919021 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-66658d3c-80f7-414c-aeb8-dfec68746d0d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:13.919470 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-66658d3c-80f7-414c-aeb8-dfec68746d0d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:13.920283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-66658d3c-80f7-414c-aeb8-dfec68746d0d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:13.920718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-66658d3c-80f7-414c-aeb8-dfec68746d0d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:14.064589 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-66658d3c-80f7-414c-aeb8-dfec68746d0d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:14.075930 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-66658d3c-80f7-414c-aeb8-dfec68746d0d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:14.078131 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-66658d3c-80f7-414c-aeb8-dfec68746d0d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:14.079982 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-66658d3c-80f7-414c-aeb8-dfec68746d0d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1731 microversion: 2.20 time: 0.171788 May 10 03:25:14.081219 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 438/891] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:25:13 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:25:14.773692 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-5cf02d87-0ec1-4465-83dc-812df2874fca req-09af17bc-0af6-4d68-82d9-3abab484f7da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d490231e-628d-467d-a571-2538c3646f1e", "name": "network-vif-plugged", "status": "completed", "tag": "e8ecbe35-34e0-4751-a0e4-9587716eaf81"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:25:14.782829 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-5cf02d87-0ec1-4465-83dc-812df2874fca req-09af17bc-0af6-4d68-82d9-3abab484f7da service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:14.783274 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-5cf02d87-0ec1-4465-83dc-812df2874fca req-09af17bc-0af6-4d68-82d9-3abab484f7da service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:14.793991 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-5cf02d87-0ec1-4465-83dc-812df2874fca req-09af17bc-0af6-4d68-82d9-3abab484f7da service nova] Creating event network-vif-plugged:e8ecbe35-34e0-4751-a0e4-9587716eaf81 for instance d490231e-628d-467d-a571-2538c3646f1e on hv-cinder-83009 May 10 03:25:14.799446 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-5cf02d87-0ec1-4465-83dc-812df2874fca req-09af17bc-0af6-4d68-82d9-3abab484f7da service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029430 May 10 03:25:14.800211 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 454/892] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:25:15.099743 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-5dc3b1ae-3973-4c86-9ca7-3453677d540a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:15.100404 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-5dc3b1ae-3973-4c86-9ca7-3453677d540a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:15.106769 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5dc3b1ae-3973-4c86-9ca7-3453677d540a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:15.107433 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5dc3b1ae-3973-4c86-9ca7-3453677d540a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:15.108315 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5dc3b1ae-3973-4c86-9ca7-3453677d540a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:15.108753 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5dc3b1ae-3973-4c86-9ca7-3453677d540a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:15.251974 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5dc3b1ae-3973-4c86-9ca7-3453677d540a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:15.263127 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5dc3b1ae-3973-4c86-9ca7-3453677d540a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:15.263592 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-5dc3b1ae-3973-4c86-9ca7-3453677d540a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:15.264828 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-5dc3b1ae-3973-4c86-9ca7-3453677d540a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1731 microversion: 2.20 time: 0.170142 May 10 03:25:15.266408 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 439/893] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:25:15 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:25:16.284999 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-4bb95cd2-1023-4205-9d4d-24aeb9e6d9d7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:16.285794 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-4bb95cd2-1023-4205-9d4d-24aeb9e6d9d7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:16.293729 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4bb95cd2-1023-4205-9d4d-24aeb9e6d9d7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:16.294198 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4bb95cd2-1023-4205-9d4d-24aeb9e6d9d7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:16.295062 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4bb95cd2-1023-4205-9d4d-24aeb9e6d9d7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:16.295424 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4bb95cd2-1023-4205-9d4d-24aeb9e6d9d7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:16.446240 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-4bb95cd2-1023-4205-9d4d-24aeb9e6d9d7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:16.456799 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-4bb95cd2-1023-4205-9d4d-24aeb9e6d9d7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:16.459465 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-4bb95cd2-1023-4205-9d4d-24aeb9e6d9d7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:16.461426 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-4bb95cd2-1023-4205-9d4d-24aeb9e6d9d7 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1731 microversion: 2.20 time: 0.181299 May 10 03:25:16.462178 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 455/894] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:25:16 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:25:17.481012 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-03ea21a7-22f3-40c8-b307-2de0ebfa166b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:17.481707 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-03ea21a7-22f3-40c8-b307-2de0ebfa166b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:17.488773 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-03ea21a7-22f3-40c8-b307-2de0ebfa166b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:17.489312 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-03ea21a7-22f3-40c8-b307-2de0ebfa166b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:17.490172 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-03ea21a7-22f3-40c8-b307-2de0ebfa166b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:17.490733 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-03ea21a7-22f3-40c8-b307-2de0ebfa166b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:17.632685 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-03ea21a7-22f3-40c8-b307-2de0ebfa166b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:17.640517 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-03ea21a7-22f3-40c8-b307-2de0ebfa166b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:17.642216 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-03ea21a7-22f3-40c8-b307-2de0ebfa166b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:17.643199 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-03ea21a7-22f3-40c8-b307-2de0ebfa166b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1731 microversion: 2.20 time: 0.166329 May 10 03:25:17.643813 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 440/895] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:25:17 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:25:18.669571 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-695b9310-59e1-480a-8396-04abca7d2db3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:18.669571 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-695b9310-59e1-480a-8396-04abca7d2db3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:18.670147 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-695b9310-59e1-480a-8396-04abca7d2db3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:18.670333 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-695b9310-59e1-480a-8396-04abca7d2db3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:18.671115 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-695b9310-59e1-480a-8396-04abca7d2db3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:18.671555 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-695b9310-59e1-480a-8396-04abca7d2db3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:18.818633 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-695b9310-59e1-480a-8396-04abca7d2db3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:18.828387 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-695b9310-59e1-480a-8396-04abca7d2db3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:18.830429 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-695b9310-59e1-480a-8396-04abca7d2db3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:18.831809 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-695b9310-59e1-480a-8396-04abca7d2db3 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1718 microversion: 2.20 time: 0.174012 May 10 03:25:18.833889 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 456/896] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:25:18 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1718 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:25:29.173751 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-f461f94d-6345-40d9-b3c6-8c352e1afd07 req-636b0ce2-b2fd-4562-b618-6056a7a6c481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8", "tag": "d0c4a220-cc8c-4389-8209-eac5e6740986"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:25:29.178484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-faba3bc9-68e0-40fb-8341-760a5860e736 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:29.178484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-faba3bc9-68e0-40fb-8341-760a5860e736 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:29.190381 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-faba3bc9-68e0-40fb-8341-760a5860e736 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:29.190760 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-faba3bc9-68e0-40fb-8341-760a5860e736 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:29.191550 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-faba3bc9-68e0-40fb-8341-760a5860e736 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:29.194987 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-f461f94d-6345-40d9-b3c6-8c352e1afd07 req-636b0ce2-b2fd-4562-b618-6056a7a6c481 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:29.195682 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-faba3bc9-68e0-40fb-8341-760a5860e736 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:29.197348 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-f461f94d-6345-40d9-b3c6-8c352e1afd07 req-636b0ce2-b2fd-4562-b618-6056a7a6c481 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:29.227887 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-f461f94d-6345-40d9-b3c6-8c352e1afd07 req-636b0ce2-b2fd-4562-b618-6056a7a6c481 service nova] Creating event network-changed:d0c4a220-cc8c-4389-8209-eac5e6740986 for instance 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 on hv-cinder-83009 May 10 03:25:29.236835 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-f461f94d-6345-40d9-b3c6-8c352e1afd07 req-636b0ce2-b2fd-4562-b618-6056a7a6c481 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067414 May 10 03:25:29.243251 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 457/897] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:25:29.248988 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-faba3bc9-68e0-40fb-8341-760a5860e736 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Going to try to terminate instance {{(pid=117400) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:25:29.675558 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-faba3bc9-68e0-40fb-8341-760a5860e736 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 204 len: 0 microversion: 2.1 time: 0.511207 May 10 03:25:29.676420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 441/898] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:25:29 2022] DELETE /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:25:29.685833 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-50dae7a8-770e-4de5-a369-4b69626cd1e1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:29.686651 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-50dae7a8-770e-4de5-a369-4b69626cd1e1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:29.694970 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-50dae7a8-770e-4de5-a369-4b69626cd1e1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:29.698955 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-50dae7a8-770e-4de5-a369-4b69626cd1e1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:29.698955 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-50dae7a8-770e-4de5-a369-4b69626cd1e1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:29.698955 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-50dae7a8-770e-4de5-a369-4b69626cd1e1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:29.851194 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-50dae7a8-770e-4de5-a369-4b69626cd1e1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:29.859490 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-50dae7a8-770e-4de5-a369-4b69626cd1e1 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1570 microversion: 2.1 time: 0.177822 May 10 03:25:29.861638 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 458/899] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:29 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:25:30.881389 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-39bf0dc9-8fe2-4e87-a138-6c372aa7136a tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:30.882180 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-39bf0dc9-8fe2-4e87-a138-6c372aa7136a tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:30.888732 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-39bf0dc9-8fe2-4e87-a138-6c372aa7136a tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:30.889181 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-39bf0dc9-8fe2-4e87-a138-6c372aa7136a tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:30.889943 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-39bf0dc9-8fe2-4e87-a138-6c372aa7136a tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:30.890377 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-39bf0dc9-8fe2-4e87-a138-6c372aa7136a tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:31.044849 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-39bf0dc9-8fe2-4e87-a138-6c372aa7136a tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:31.052601 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-39bf0dc9-8fe2-4e87-a138-6c372aa7136a tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1570 microversion: 2.1 time: 0.175443 May 10 03:25:31.054103 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 442/900] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:30 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:31.691429 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-06114d5f-57f3-4a67-b75e-8f2f4448bfa2 req-f630b0a9-40da-4370-9a0f-0a4851d28163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8", "name": "network-vif-deleted", "tag": "d0c4a220-cc8c-4389-8209-eac5e6740986"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:25:31.700960 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-06114d5f-57f3-4a67-b75e-8f2f4448bfa2 req-f630b0a9-40da-4370-9a0f-0a4851d28163 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:31.701436 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-06114d5f-57f3-4a67-b75e-8f2f4448bfa2 req-f630b0a9-40da-4370-9a0f-0a4851d28163 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:31.712837 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-06114d5f-57f3-4a67-b75e-8f2f4448bfa2 req-f630b0a9-40da-4370-9a0f-0a4851d28163 service nova] Creating event network-vif-deleted:d0c4a220-cc8c-4389-8209-eac5e6740986 for instance 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 on hv-cinder-83009 May 10 03:25:31.717749 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-06114d5f-57f3-4a67-b75e-8f2f4448bfa2 req-f630b0a9-40da-4370-9a0f-0a4851d28163 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030586 May 10 03:25:31.719263 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 459/901] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:25:32.070494 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-e30a89cc-fd5d-4026-a87a-9b36813290aa tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:32.071260 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-e30a89cc-fd5d-4026-a87a-9b36813290aa tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:32.077580 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e30a89cc-fd5d-4026-a87a-9b36813290aa tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:32.078374 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e30a89cc-fd5d-4026-a87a-9b36813290aa tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:32.079377 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e30a89cc-fd5d-4026-a87a-9b36813290aa tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:32.079822 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e30a89cc-fd5d-4026-a87a-9b36813290aa tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:32.142952 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-e30a89cc-fd5d-4026-a87a-9b36813290aa tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a49b27f57e9049518e157d39f6901bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4524e2de8e8e4dbfa1cb85515dbeb90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:32.151438 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-e30a89cc-fd5d-4026-a87a-9b36813290aa tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 200 len: 1220 microversion: 2.1 time: 0.085945 May 10 03:25:32.152180 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 443/902] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:32 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:33.168423 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-3b69659e-d93a-43ce-8f05-a8366b387895 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:33.169114 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-3b69659e-d93a-43ce-8f05-a8366b387895 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] [instance: 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:33.175979 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3b69659e-d93a-43ce-8f05-a8366b387895 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:33.176472 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3b69659e-d93a-43ce-8f05-a8366b387895 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:33.177289 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3b69659e-d93a-43ce-8f05-a8366b387895 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:33.177762 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3b69659e-d93a-43ce-8f05-a8366b387895 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:33.193493 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-3b69659e-d93a-43ce-8f05-a8366b387895 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] HTTP exception thrown: Instance 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 could not be found. May 10 03:25:33.195705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-3b69659e-d93a-43ce-8f05-a8366b387895 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Request method failure captured: May 10 03:25:33.195705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 HTTP/1.1 May 10 03:25:33.195705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:25:33.195705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:25:33.195705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:25:33.195705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:25:33.195705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:25:33.195705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:25:33.195705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:25:33.195705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:25:33.195705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedn4WhLqL5UkG32DJHLwNNIJB5Xh10jGUkahwQBhmjRs4F7ck9hmRenAaDwqSDLf8UkioTVKUJABDzlY5U0ZouSCZ5OT7UOvuAQtlu2DqJqPdokyoWGcpJnkqeX_J4W3aszg3OoaRGGcpkDERGcJyjC3uJL2_oEMcNL286CnR607GTg May 10 03:25:33.195705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:25:33.195705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:25:33.195705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:25:33.195705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:25:33.195705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:25:33.195705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:25:33.195705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: 4524e2de8e8e4dbfa1cb85515dbeb90a May 10 03:25:33.195705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-TestShelveInstance-879273607 May 10 03:25:33.195705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:25:33.195705 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:25:33.203053 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4524e2de8e8e4dbfa1cb85515dbeb90a", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4524e2de8e8e4dbfa1cb85515dbeb90a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4524e2de8e8e4dbfa1cb85515dbeb90a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4524e2de8e8e4dbfa1cb85515dbeb90a"}]}] May 10 03:25:33.203053 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-TestShelveInstance-879273607 May 10 03:25:33.203053 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: 4524e2de8e8e4dbfa1cb85515dbeb90a May 10 03:25:33.203053 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-TestShelveInstance-879273607 May 10 03:25:33.203053 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-TestShelveInstance-879273607-project May 10 03:25:33.203053 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:25:33.203053 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:25:33.203053 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: a49b27f57e9049518e157d39f6901bd7 May 10 03:25:33.203053 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-TestShelveInstance-879273607-project May 10 03:25:33.203053 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: > May 10 03:25:33.203053 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Instance 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 could not be found. May 10 03:25:33.203053 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': '7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8'} May 10 03:25:33.204118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:25:33.204118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:33.204118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:25:33.204118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:25:33.204118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:25:33.204118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:25:33.204118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:25:33.204118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:25:33.204118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:25:33.204118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:25:33.204118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 could not be found. May 10 03:25:33.204118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:33.204118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:33.204118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:33.204118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:33.204118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:33.204118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:33.204118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:25:33.204118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:25:33.204118 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:25:33.205622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:25:33.205622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:25:33.205622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:25:33.205622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:25:33.205622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:25:33.205622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:25:33.205622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:25:33.205622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 could not be found. May 10 03:25:33.205622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:33.205622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:33.205622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:33.205622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:33.205622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:33.205622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:33.205622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:25:33.205622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:25:33.205622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 could not be found. May 10 03:25:33.205622 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:33.206954 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-3b69659e-d93a-43ce-8f05-a8366b387895 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Returning 404 to user: Instance 7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:25:33.206954 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-3b69659e-d93a-43ce-8f05-a8366b387895 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8" status: 404 len: 111 microversion: 2.1 time: 0.033451 May 10 03:25:33.206954 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 460/903] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:33 2022] GET /compute/v2.1/servers/7a7ac22a-4d95-4df1-9596-feb7ac6a6dd8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:25:33.677168 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-17c7f235-7850-4d55-845c-445b11209569 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] Calling method '.version_select at 0x7f6a5d09c550>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:33.771509 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-17c7f235-7850-4d55-845c-445b11209569 tempest-TestShelveInstance-879273607 tempest-TestShelveInstance-879273607-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1309171344" status: 202 len: 0 microversion: 2.1 time: 0.268978 May 10 03:25:33.772077 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 444/904] 10.222.0.65 () {58 vars in 1253 bytes} [Tue May 10 03:25:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1309171344 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:25:37.169042 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-44be893c-6e28-4b07-a316-e3aeadd8544f tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1057785750", "imageRef": "7ce6e103-a571-4b59-9162-ff1107650c97", "flavorRef": "452", "networks": [{"uuid": "d1064445-058f-4acb-8639-19d5bf2e7ba7"}]}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:25:37.220812 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.network.neutron [None req-44be893c-6e28-4b07-a316-e3aeadd8544f tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] validate_networks() for [('d1064445-058f-4acb-8639-19d5bf2e7ba7', None, None, None, None, None)] {{(pid=117399) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:25:37.894341 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-44be893c-6e28-4b07-a316-e3aeadd8544f tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Flavor limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:25:37.894769 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-44be893c-6e28-4b07-a316-e3aeadd8544f tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Image limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:25:37.895281 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-44be893c-6e28-4b07-a316-e3aeadd8544f tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Flavor pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:25:37.895690 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-44be893c-6e28-4b07-a316-e3aeadd8544f tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Image pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:25:37.896126 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-44be893c-6e28-4b07-a316-e3aeadd8544f tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:25:37.905174 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-44be893c-6e28-4b07-a316-e3aeadd8544f tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:37.905625 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-44be893c-6e28-4b07-a316-e3aeadd8544f tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:37.906651 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-44be893c-6e28-4b07-a316-e3aeadd8544f tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:37.907095 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-44be893c-6e28-4b07-a316-e3aeadd8544f tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:37.923951 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-44be893c-6e28-4b07-a316-e3aeadd8544f tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Getting quotas for project dfdd3106ad0d445fb9866648596f811e. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:25:37.927822 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-44be893c-6e28-4b07-a316-e3aeadd8544f tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Getting quotas for user 285cbf50fac34905b72f620030429585 and project dfdd3106ad0d445fb9866648596f811e. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:25:37.939611 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-44be893c-6e28-4b07-a316-e3aeadd8544f tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Going to run 1 instances... {{(pid=117399) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:25:37.941929 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-44be893c-6e28-4b07-a316-e3aeadd8544f tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] [instance: 70461bd7-372f-4190-bcea-c048ecdfc83a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ce6e103-a571-4b59-9162-ff1107650c97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:25:38.053686 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-44be893c-6e28-4b07-a316-e3aeadd8544f tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.085249 May 10 03:25:38.060597 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 461/905] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 03:25:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 03:25:38.065360 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-236efd6e-8caa-4527-b4c1-74924a4ec786 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:38.066033 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-236efd6e-8caa-4527-b4c1-74924a4ec786 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] [instance: 70461bd7-372f-4190-bcea-c048ecdfc83a] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:38.146499 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-236efd6e-8caa-4527-b4c1-74924a4ec786 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285cbf50fac34905b72f620030429585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdd3106ad0d445fb9866648596f811e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:38.154024 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-236efd6e-8caa-4527-b4c1-74924a4ec786 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] 10.222.0.65 "GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a" status: 200 len: 1214 microversion: 2.1 time: 0.093109 May 10 03:25:38.163601 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 445/906] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:38 2022] GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:25:39.171482 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-79b45e26-0703-485c-bcba-a9edc3f76afa tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:39.172269 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-79b45e26-0703-485c-bcba-a9edc3f76afa tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] [instance: 70461bd7-372f-4190-bcea-c048ecdfc83a] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:39.224787 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-79b45e26-0703-485c-bcba-a9edc3f76afa tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285cbf50fac34905b72f620030429585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdd3106ad0d445fb9866648596f811e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:39.233172 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-79b45e26-0703-485c-bcba-a9edc3f76afa tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] 10.222.0.65 "GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a" status: 200 len: 1214 microversion: 2.1 time: 0.066207 May 10 03:25:39.233709 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 462/907] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:39 2022] GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:40.250235 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-e0337a5c-ac0f-4bd3-a834-cdc6548c4c54 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:40.250850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-e0337a5c-ac0f-4bd3-a834-cdc6548c4c54 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] [instance: 70461bd7-372f-4190-bcea-c048ecdfc83a] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:40.257418 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e0337a5c-ac0f-4bd3-a834-cdc6548c4c54 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:40.257814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e0337a5c-ac0f-4bd3-a834-cdc6548c4c54 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:40.258592 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e0337a5c-ac0f-4bd3-a834-cdc6548c4c54 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:40.259030 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-e0337a5c-ac0f-4bd3-a834-cdc6548c4c54 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:40.336934 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-e0337a5c-ac0f-4bd3-a834-cdc6548c4c54 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285cbf50fac34905b72f620030429585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdd3106ad0d445fb9866648596f811e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:40.345087 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-e0337a5c-ac0f-4bd3-a834-cdc6548c4c54 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] 10.222.0.65 "GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a" status: 200 len: 1266 microversion: 2.1 time: 0.099115 May 10 03:25:40.345858 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 446/908] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:40 2022] GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:41.362728 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-9ac7d78f-5025-4fcd-acb4-1f5310067b69 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:41.363465 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-9ac7d78f-5025-4fcd-acb4-1f5310067b69 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] [instance: 70461bd7-372f-4190-bcea-c048ecdfc83a] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:41.382501 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9ac7d78f-5025-4fcd-acb4-1f5310067b69 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:41.387923 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9ac7d78f-5025-4fcd-acb4-1f5310067b69 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:41.387923 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9ac7d78f-5025-4fcd-acb4-1f5310067b69 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:41.387923 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9ac7d78f-5025-4fcd-acb4-1f5310067b69 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:41.450539 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-9ac7d78f-5025-4fcd-acb4-1f5310067b69 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285cbf50fac34905b72f620030429585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdd3106ad0d445fb9866648596f811e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:41.464185 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-9ac7d78f-5025-4fcd-acb4-1f5310067b69 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] 10.222.0.65 "GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a" status: 200 len: 1272 microversion: 2.1 time: 0.105215 May 10 03:25:41.465055 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 463/909] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:41 2022] GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a => generated 1272 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:42.483021 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-3870b67a-8160-44b5-807d-e5746624e690 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:42.483643 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-3870b67a-8160-44b5-807d-e5746624e690 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] [instance: 70461bd7-372f-4190-bcea-c048ecdfc83a] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:42.490239 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3870b67a-8160-44b5-807d-e5746624e690 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:42.490946 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3870b67a-8160-44b5-807d-e5746624e690 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:42.491993 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3870b67a-8160-44b5-807d-e5746624e690 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:42.492464 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3870b67a-8160-44b5-807d-e5746624e690 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:42.706857 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-3870b67a-8160-44b5-807d-e5746624e690 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285cbf50fac34905b72f620030429585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdd3106ad0d445fb9866648596f811e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:42.725112 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-3870b67a-8160-44b5-807d-e5746624e690 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] 10.222.0.65 "GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a" status: 200 len: 1314 microversion: 2.1 time: 0.245956 May 10 03:25:42.726377 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 447/910] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:42 2022] GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:42.901813 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-9af4847d-4b69-4a68-a4fd-fd6b5265a08a req-9c25b1f2-f1fe-4abd-9d68-e52b7ff58326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70461bd7-372f-4190-bcea-c048ecdfc83a", "tag": "3973e790-3cc6-4c24-a035-e7250209a2bc"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:25:42.910246 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-9af4847d-4b69-4a68-a4fd-fd6b5265a08a req-9c25b1f2-f1fe-4abd-9d68-e52b7ff58326 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:42.910687 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-9af4847d-4b69-4a68-a4fd-fd6b5265a08a req-9c25b1f2-f1fe-4abd-9d68-e52b7ff58326 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:42.924053 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-9af4847d-4b69-4a68-a4fd-fd6b5265a08a req-9c25b1f2-f1fe-4abd-9d68-e52b7ff58326 service nova] Creating event network-changed:3973e790-3cc6-4c24-a035-e7250209a2bc for instance 70461bd7-372f-4190-bcea-c048ecdfc83a on hv-cinder-83009 May 10 03:25:42.930903 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-9af4847d-4b69-4a68-a4fd-fd6b5265a08a req-9c25b1f2-f1fe-4abd-9d68-e52b7ff58326 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032591 May 10 03:25:42.932388 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 464/911] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:25:43.744367 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-0c833244-48a9-43a4-93d8-d2bb7f747089 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:43.745110 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-0c833244-48a9-43a4-93d8-d2bb7f747089 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] [instance: 70461bd7-372f-4190-bcea-c048ecdfc83a] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:43.751988 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0c833244-48a9-43a4-93d8-d2bb7f747089 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:43.752589 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0c833244-48a9-43a4-93d8-d2bb7f747089 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:43.753494 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0c833244-48a9-43a4-93d8-d2bb7f747089 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:43.754041 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0c833244-48a9-43a4-93d8-d2bb7f747089 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:43.896620 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-0c833244-48a9-43a4-93d8-d2bb7f747089 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285cbf50fac34905b72f620030429585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdd3106ad0d445fb9866648596f811e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:43.903984 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-0c833244-48a9-43a4-93d8-d2bb7f747089 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] 10.222.0.65 "GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a" status: 200 len: 1314 microversion: 2.1 time: 0.165265 May 10 03:25:43.904584 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 448/912] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:43 2022] GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:44.922158 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-62696510-7570-46d3-9468-a0031094462d tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:44.923584 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-62696510-7570-46d3-9468-a0031094462d tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] [instance: 70461bd7-372f-4190-bcea-c048ecdfc83a] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:44.930367 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-62696510-7570-46d3-9468-a0031094462d tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:44.930975 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-62696510-7570-46d3-9468-a0031094462d tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:44.931866 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-62696510-7570-46d3-9468-a0031094462d tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:44.932457 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-62696510-7570-46d3-9468-a0031094462d tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:45.076178 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-62696510-7570-46d3-9468-a0031094462d tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285cbf50fac34905b72f620030429585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdd3106ad0d445fb9866648596f811e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:45.076178 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-62696510-7570-46d3-9468-a0031094462d tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] 10.222.0.65 "GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a" status: 200 len: 1314 microversion: 2.1 time: 0.157796 May 10 03:25:45.076178 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 465/913] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:44 2022] GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:46.091753 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-3f74e90a-e1f1-4c85-8989-f8b4d332dd26 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:46.092394 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-3f74e90a-e1f1-4c85-8989-f8b4d332dd26 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] [instance: 70461bd7-372f-4190-bcea-c048ecdfc83a] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:46.098894 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3f74e90a-e1f1-4c85-8989-f8b4d332dd26 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:46.099362 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3f74e90a-e1f1-4c85-8989-f8b4d332dd26 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:46.100316 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3f74e90a-e1f1-4c85-8989-f8b4d332dd26 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:46.101298 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3f74e90a-e1f1-4c85-8989-f8b4d332dd26 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:46.232592 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-3f74e90a-e1f1-4c85-8989-f8b4d332dd26 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285cbf50fac34905b72f620030429585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdd3106ad0d445fb9866648596f811e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:46.249595 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-3f74e90a-e1f1-4c85-8989-f8b4d332dd26 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] 10.222.0.65 "GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a" status: 200 len: 1314 microversion: 2.1 time: 0.153202 May 10 03:25:46.249595 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 449/914] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:46 2022] GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:47.259388 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a919e498-3b1f-4eb4-bcb1-824180c7e001 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:47.261070 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-a919e498-3b1f-4eb4-bcb1-824180c7e001 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] [instance: 70461bd7-372f-4190-bcea-c048ecdfc83a] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:47.271338 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a919e498-3b1f-4eb4-bcb1-824180c7e001 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:47.272233 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a919e498-3b1f-4eb4-bcb1-824180c7e001 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:47.273056 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a919e498-3b1f-4eb4-bcb1-824180c7e001 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:47.274212 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a919e498-3b1f-4eb4-bcb1-824180c7e001 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:47.445125 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-a919e498-3b1f-4eb4-bcb1-824180c7e001 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285cbf50fac34905b72f620030429585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdd3106ad0d445fb9866648596f811e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:47.457013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-a919e498-3b1f-4eb4-bcb1-824180c7e001 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] 10.222.0.65 "GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a" status: 200 len: 1314 microversion: 2.1 time: 0.203587 May 10 03:25:47.457676 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 466/915] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:47 2022] GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:48.474170 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-4233d712-1e88-4b63-ac77-d626f4a0f514 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:48.474772 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-4233d712-1e88-4b63-ac77-d626f4a0f514 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] [instance: 70461bd7-372f-4190-bcea-c048ecdfc83a] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:48.483054 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4233d712-1e88-4b63-ac77-d626f4a0f514 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:48.483054 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4233d712-1e88-4b63-ac77-d626f4a0f514 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:48.483054 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4233d712-1e88-4b63-ac77-d626f4a0f514 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:48.483054 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-4233d712-1e88-4b63-ac77-d626f4a0f514 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:48.642880 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-4233d712-1e88-4b63-ac77-d626f4a0f514 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285cbf50fac34905b72f620030429585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdd3106ad0d445fb9866648596f811e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:48.651367 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-4233d712-1e88-4b63-ac77-d626f4a0f514 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] 10.222.0.65 "GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a" status: 200 len: 1314 microversion: 2.1 time: 0.180995 May 10 03:25:48.651934 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 450/916] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:48 2022] GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:49.007345 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-38a553d6-5781-4ac9-9d1a-bb13a7dc6540 req-680e7fac-6166-4fe7-b26c-116e5fcd2e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70461bd7-372f-4190-bcea-c048ecdfc83a", "name": "network-vif-plugged", "status": "completed", "tag": "3973e790-3cc6-4c24-a035-e7250209a2bc"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:25:49.016473 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-38a553d6-5781-4ac9-9d1a-bb13a7dc6540 req-680e7fac-6166-4fe7-b26c-116e5fcd2e28 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:49.016947 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-38a553d6-5781-4ac9-9d1a-bb13a7dc6540 req-680e7fac-6166-4fe7-b26c-116e5fcd2e28 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:49.027981 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-38a553d6-5781-4ac9-9d1a-bb13a7dc6540 req-680e7fac-6166-4fe7-b26c-116e5fcd2e28 service nova] Creating event network-vif-plugged:3973e790-3cc6-4c24-a035-e7250209a2bc for instance 70461bd7-372f-4190-bcea-c048ecdfc83a on hv-cinder-83009 May 10 03:25:49.032860 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-38a553d6-5781-4ac9-9d1a-bb13a7dc6540 req-680e7fac-6166-4fe7-b26c-116e5fcd2e28 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029385 May 10 03:25:49.033426 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 467/917] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:25:49.668615 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-13369800-67b3-4278-8d22-d6450e70b1bf tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:49.669184 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-13369800-67b3-4278-8d22-d6450e70b1bf tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] [instance: 70461bd7-372f-4190-bcea-c048ecdfc83a] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:49.675684 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-13369800-67b3-4278-8d22-d6450e70b1bf tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:49.676178 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-13369800-67b3-4278-8d22-d6450e70b1bf tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:49.677014 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-13369800-67b3-4278-8d22-d6450e70b1bf tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:49.677449 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-13369800-67b3-4278-8d22-d6450e70b1bf tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:49.808302 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-13369800-67b3-4278-8d22-d6450e70b1bf tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285cbf50fac34905b72f620030429585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdd3106ad0d445fb9866648596f811e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:49.815785 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-13369800-67b3-4278-8d22-d6450e70b1bf tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] 10.222.0.65 "GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a" status: 200 len: 1314 microversion: 2.1 time: 0.151179 May 10 03:25:49.816397 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 451/918] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:49 2022] GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:25:50.833817 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-9b8ba28f-4bf5-4933-9890-9590c4b09bb0 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:50.834606 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-9b8ba28f-4bf5-4933-9890-9590c4b09bb0 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] [instance: 70461bd7-372f-4190-bcea-c048ecdfc83a] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:50.840704 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9b8ba28f-4bf5-4933-9890-9590c4b09bb0 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:50.841155 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9b8ba28f-4bf5-4933-9890-9590c4b09bb0 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:50.842120 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9b8ba28f-4bf5-4933-9890-9590c4b09bb0 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:50.842343 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-9b8ba28f-4bf5-4933-9890-9590c4b09bb0 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:50.972361 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-9b8ba28f-4bf5-4933-9890-9590c4b09bb0 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285cbf50fac34905b72f620030429585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdd3106ad0d445fb9866648596f811e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:50.980389 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-9b8ba28f-4bf5-4933-9890-9590c4b09bb0 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] 10.222.0.65 "GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a" status: 200 len: 1498 microversion: 2.1 time: 0.151313 May 10 03:25:50.980966 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 468/919] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:50 2022] GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a => generated 1498 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:51.270043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-2a0dbd2f-8d3c-4a6f-8ac1-75c42364e261 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2007876651", "imageRef": "7ce6e103-a571-4b59-9162-ff1107650c97", "flavorRef": "452", "networks": [{"uuid": "3b28b3fa-2732-4380-8d7f-37cccd7876c1"}]}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:25:51.319215 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.network.neutron [None req-2a0dbd2f-8d3c-4a6f-8ac1-75c42364e261 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] validate_networks() for [('3b28b3fa-2732-4380-8d7f-37cccd7876c1', None, None, None, None, None)] {{(pid=117400) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:25:51.723218 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-2a0dbd2f-8d3c-4a6f-8ac1-75c42364e261 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Flavor limits 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:25:51.723663 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-2a0dbd2f-8d3c-4a6f-8ac1-75c42364e261 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Image limits 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:25:51.724171 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-2a0dbd2f-8d3c-4a6f-8ac1-75c42364e261 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Flavor pref 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:25:51.724749 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-2a0dbd2f-8d3c-4a6f-8ac1-75c42364e261 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Image pref 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:25:51.725168 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-2a0dbd2f-8d3c-4a6f-8ac1-75c42364e261 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:25:51.735826 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2a0dbd2f-8d3c-4a6f-8ac1-75c42364e261 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:51.739671 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2a0dbd2f-8d3c-4a6f-8ac1-75c42364e261 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:51.740624 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2a0dbd2f-8d3c-4a6f-8ac1-75c42364e261 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:51.741140 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-2a0dbd2f-8d3c-4a6f-8ac1-75c42364e261 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:51.758993 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-2a0dbd2f-8d3c-4a6f-8ac1-75c42364e261 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Getting quotas for project f3186bec57c94e2f84ae52cae506dbc2. Resources: {'cores', 'instances', 'ram'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:25:51.762923 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-2a0dbd2f-8d3c-4a6f-8ac1-75c42364e261 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Getting quotas for user f43ec3800caa42ed9a4fcf3405ef3d5e and project f3186bec57c94e2f84ae52cae506dbc2. Resources: {'cores', 'instances', 'ram'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:25:51.773685 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-2a0dbd2f-8d3c-4a6f-8ac1-75c42364e261 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Going to run 1 instances... {{(pid=117400) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:25:51.775943 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-2a0dbd2f-8d3c-4a6f-8ac1-75c42364e261 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ce6e103-a571-4b59-9162-ff1107650c97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:25:51.895845 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2a0dbd2f-8d3c-4a6f-8ac1-75c42364e261 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [c0a7a104-6196-438b-af17-1d0067574642] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 03:25:52.039004 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-5b718690-a98b-4da8-8fca-379864098a84 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:52.040231 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-5b718690-a98b-4da8-8fca-379864098a84 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:52.047550 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5b718690-a98b-4da8-8fca-379864098a84 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:52.048270 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5b718690-a98b-4da8-8fca-379864098a84 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:52.049350 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5b718690-a98b-4da8-8fca-379864098a84 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:52.049814 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5b718690-a98b-4da8-8fca-379864098a84 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:52.081761 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-5b718690-a98b-4da8-8fca-379864098a84 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050405 May 10 03:25:52.085922 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 469/920] 10.222.0.65 () {60 vars in 1342 bytes} [Tue May 10 03:25:52 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:25:52.154126 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-6f1e07de-11b6-4aa9-85ef-2fed1ce4005d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:52.154875 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-6f1e07de-11b6-4aa9-85ef-2fed1ce4005d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:52.161400 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6f1e07de-11b6-4aa9-85ef-2fed1ce4005d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:52.161858 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6f1e07de-11b6-4aa9-85ef-2fed1ce4005d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:52.162640 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6f1e07de-11b6-4aa9-85ef-2fed1ce4005d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:52.163065 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6f1e07de-11b6-4aa9-85ef-2fed1ce4005d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:52.188154 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-6f1e07de-11b6-4aa9-85ef-2fed1ce4005d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Going to try to terminate instance {{(pid=117399) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:25:52.445319 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-6f1e07de-11b6-4aa9-85ef-2fed1ce4005d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 204 len: 0 microversion: 2.20 time: 0.295658 May 10 03:25:52.445906 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 470/921] 10.222.0.65 () {60 vars in 1279 bytes} [Tue May 10 03:25:52 2022] DELETE /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 03:25:52.464765 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-88dc3ad2-9103-4413-8309-628ee08c9afe tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:52.465483 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-88dc3ad2-9103-4413-8309-628ee08c9afe tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:52.471732 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-88dc3ad2-9103-4413-8309-628ee08c9afe tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:52.471918 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-88dc3ad2-9103-4413-8309-628ee08c9afe tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:52.472721 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-88dc3ad2-9103-4413-8309-628ee08c9afe tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:52.473156 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-88dc3ad2-9103-4413-8309-628ee08c9afe tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:52.602976 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-88dc3ad2-9103-4413-8309-628ee08c9afe tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:52.611259 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-88dc3ad2-9103-4413-8309-628ee08c9afe tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:52.613284 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-88dc3ad2-9103-4413-8309-628ee08c9afe tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:52.614645 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-88dc3ad2-9103-4413-8309-628ee08c9afe tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1724 microversion: 2.20 time: 0.154637 May 10 03:25:52.615194 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 471/922] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:25:52 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:25:52.903484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO oslo.messaging._drivers.impl_rabbit [None req-2a0dbd2f-8d3c-4a6f-8ac1-75c42364e261 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [c0a7a104-6196-438b-af17-1d0067574642] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 43760. May 10 03:25:52.908027 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-2a0dbd2f-8d3c-4a6f-8ac1-75c42364e261 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.643962 May 10 03:25:52.908889 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 452/923] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 03:25:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:25:52.918794 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-1d602536-b6b0-4365-a139-ea95a042f8f5 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:52.919405 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-1d602536-b6b0-4365-a139-ea95a042f8f5 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:52.979239 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-1d602536-b6b0-4365-a139-ea95a042f8f5 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:52.983644 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-1d602536-b6b0-4365-a139-ea95a042f8f5 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b" status: 200 len: 1219 microversion: 2.1 time: 0.068805 May 10 03:25:52.984250 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 472/924] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:52 2022] GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:25:53.634585 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-f91793ce-f68d-43a0-9228-fc15a9a4b370 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:53.635202 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-f91793ce-f68d-43a0-9228-fc15a9a4b370 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:53.641769 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f91793ce-f68d-43a0-9228-fc15a9a4b370 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:53.642222 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f91793ce-f68d-43a0-9228-fc15a9a4b370 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:53.642984 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f91793ce-f68d-43a0-9228-fc15a9a4b370 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:53.643444 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-f91793ce-f68d-43a0-9228-fc15a9a4b370 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:53.773392 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-f91793ce-f68d-43a0-9228-fc15a9a4b370 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:53.781845 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-f91793ce-f68d-43a0-9228-fc15a9a4b370 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:53.783381 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-f91793ce-f68d-43a0-9228-fc15a9a4b370 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:53.784604 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-f91793ce-f68d-43a0-9228-fc15a9a4b370 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1724 microversion: 2.20 time: 0.154907 May 10 03:25:53.785206 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 453/925] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:25:53 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:25:54.012843 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-532cc48a-b5d1-4e1f-ad00-728c7d840737 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:54.017235 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-532cc48a-b5d1-4e1f-ad00-728c7d840737 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:54.031220 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-532cc48a-b5d1-4e1f-ad00-728c7d840737 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:54.035167 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-532cc48a-b5d1-4e1f-ad00-728c7d840737 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:54.035167 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-532cc48a-b5d1-4e1f-ad00-728c7d840737 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:54.035167 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-532cc48a-b5d1-4e1f-ad00-728c7d840737 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:54.085363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-53eae858-36c6-4fa8-890d-e14a5d8f04b7 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:54.086855 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-53eae858-36c6-4fa8-890d-e14a5d8f04b7 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] [instance: 70461bd7-372f-4190-bcea-c048ecdfc83a] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:54.094646 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-53eae858-36c6-4fa8-890d-e14a5d8f04b7 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:54.095229 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-53eae858-36c6-4fa8-890d-e14a5d8f04b7 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:54.096186 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-53eae858-36c6-4fa8-890d-e14a5d8f04b7 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:54.096819 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-53eae858-36c6-4fa8-890d-e14a5d8f04b7 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:54.110286 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-532cc48a-b5d1-4e1f-ad00-728c7d840737 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:54.118564 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-532cc48a-b5d1-4e1f-ad00-728c7d840737 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b" status: 200 len: 1223 microversion: 2.1 time: 0.117667 May 10 03:25:54.120779 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 473/926] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:53 2022] GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b => generated 1223 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:54.129681 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-53eae858-36c6-4fa8-890d-e14a5d8f04b7 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] [instance: 70461bd7-372f-4190-bcea-c048ecdfc83a] Going to try to terminate instance {{(pid=117400) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:25:54.404904 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-53eae858-36c6-4fa8-890d-e14a5d8f04b7 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] 10.222.0.65 "DELETE /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a" status: 204 len: 0 microversion: 2.1 time: 0.323628 May 10 03:25:54.405504 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 454/927] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:25:54 2022] DELETE /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 03:25:54.415551 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-d8ecaabf-75f7-4e42-9bd6-995a96946559 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:54.416337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-d8ecaabf-75f7-4e42-9bd6-995a96946559 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] [instance: 70461bd7-372f-4190-bcea-c048ecdfc83a] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:54.425122 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d8ecaabf-75f7-4e42-9bd6-995a96946559 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:54.425820 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d8ecaabf-75f7-4e42-9bd6-995a96946559 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:54.426781 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d8ecaabf-75f7-4e42-9bd6-995a96946559 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:54.427218 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d8ecaabf-75f7-4e42-9bd6-995a96946559 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:54.569276 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-d8ecaabf-75f7-4e42-9bd6-995a96946559 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285cbf50fac34905b72f620030429585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdd3106ad0d445fb9866648596f811e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:54.578103 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-d8ecaabf-75f7-4e42-9bd6-995a96946559 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] 10.222.0.65 "GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a" status: 200 len: 1504 microversion: 2.1 time: 0.168041 May 10 03:25:54.579070 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 474/928] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:54 2022] GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:54.805507 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-32c710d6-3ff7-4f38-8af5-46dafe561a59 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:54.805965 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-32c710d6-3ff7-4f38-8af5-46dafe561a59 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:54.821579 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-32c710d6-3ff7-4f38-8af5-46dafe561a59 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:54.822033 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-32c710d6-3ff7-4f38-8af5-46dafe561a59 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:54.823321 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-32c710d6-3ff7-4f38-8af5-46dafe561a59 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:54.823773 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-32c710d6-3ff7-4f38-8af5-46dafe561a59 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:54.850636 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-82695791-6145-4b81-a4bd-53fb239319b1 req-2e2aa004-403a-429c-88a3-7561d3b5b9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d490231e-628d-467d-a571-2538c3646f1e", "name": "network-vif-deleted", "tag": "e8ecbe35-34e0-4751-a0e4-9587716eaf81"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:25:54.859770 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-82695791-6145-4b81-a4bd-53fb239319b1 req-2e2aa004-403a-429c-88a3-7561d3b5b9e3 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:54.860135 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-82695791-6145-4b81-a4bd-53fb239319b1 req-2e2aa004-403a-429c-88a3-7561d3b5b9e3 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:54.873897 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-82695791-6145-4b81-a4bd-53fb239319b1 req-2e2aa004-403a-429c-88a3-7561d3b5b9e3 service nova] Creating event network-vif-deleted:e8ecbe35-34e0-4751-a0e4-9587716eaf81 for instance d490231e-628d-467d-a571-2538c3646f1e on hv-cinder-83009 May 10 03:25:54.879256 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-82695791-6145-4b81-a4bd-53fb239319b1 req-2e2aa004-403a-429c-88a3-7561d3b5b9e3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032057 May 10 03:25:54.880444 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 475/929] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:25:54.921073 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-32c710d6-3ff7-4f38-8af5-46dafe561a59 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:54.929284 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-32c710d6-3ff7-4f38-8af5-46dafe561a59 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:54.930757 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-32c710d6-3ff7-4f38-8af5-46dafe561a59 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:54.931912 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-32c710d6-3ff7-4f38-8af5-46dafe561a59 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1657 microversion: 2.20 time: 0.132666 May 10 03:25:54.933036 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 455/930] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:25:54 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1657 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:25:55.139858 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ecb86262-dfe5-461d-9887-03ca83559764 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:55.141037 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ecb86262-dfe5-461d-9887-03ca83559764 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:55.148528 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ecb86262-dfe5-461d-9887-03ca83559764 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:55.148980 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ecb86262-dfe5-461d-9887-03ca83559764 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:55.149771 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ecb86262-dfe5-461d-9887-03ca83559764 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:55.150214 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ecb86262-dfe5-461d-9887-03ca83559764 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:55.222672 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ecb86262-dfe5-461d-9887-03ca83559764 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:55.231009 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ecb86262-dfe5-461d-9887-03ca83559764 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b" status: 200 len: 1271 microversion: 2.1 time: 0.097801 May 10 03:25:55.233438 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 476/931] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:55 2022] GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:55.595814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-1b5b45da-86cc-44a9-8dcf-2b128464622d tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:55.596380 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-1b5b45da-86cc-44a9-8dcf-2b128464622d tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] [instance: 70461bd7-372f-4190-bcea-c048ecdfc83a] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:55.602242 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1b5b45da-86cc-44a9-8dcf-2b128464622d tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:55.602853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1b5b45da-86cc-44a9-8dcf-2b128464622d tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:55.603631 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1b5b45da-86cc-44a9-8dcf-2b128464622d tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:55.604120 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-1b5b45da-86cc-44a9-8dcf-2b128464622d tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:55.749707 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-1b5b45da-86cc-44a9-8dcf-2b128464622d tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285cbf50fac34905b72f620030429585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdd3106ad0d445fb9866648596f811e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:55.758623 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-1b5b45da-86cc-44a9-8dcf-2b128464622d tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] 10.222.0.65 "GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a" status: 200 len: 1504 microversion: 2.1 time: 0.167070 May 10 03:25:55.759316 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 456/932] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:55 2022] GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:55.962694 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-52e66a68-f27b-4507-aa9e-c8011b16f870 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:55.963491 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-52e66a68-f27b-4507-aa9e-c8011b16f870 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:55.969817 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-52e66a68-f27b-4507-aa9e-c8011b16f870 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:55.970477 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-52e66a68-f27b-4507-aa9e-c8011b16f870 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:55.971772 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-52e66a68-f27b-4507-aa9e-c8011b16f870 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:55.972243 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-52e66a68-f27b-4507-aa9e-c8011b16f870 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:56.024694 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-52e66a68-f27b-4507-aa9e-c8011b16f870 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:56.025147 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-52e66a68-f27b-4507-aa9e-c8011b16f870 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:56.025599 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.objects.instance [None req-52e66a68-f27b-4507-aa9e-c8011b16f870 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lazy-loading 'fault' on Instance uuid d490231e-628d-467d-a571-2538c3646f1e {{(pid=117399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:25:56.089160 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-52e66a68-f27b-4507-aa9e-c8011b16f870 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:56.099221 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-52e66a68-f27b-4507-aa9e-c8011b16f870 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:56.100692 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-52e66a68-f27b-4507-aa9e-c8011b16f870 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9dff947a164641e7b32c639bebbffe36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af328ed59384b70b2312c150a124746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:56.102246 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-52e66a68-f27b-4507-aa9e-c8011b16f870 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 200 len: 1372 microversion: 2.20 time: 0.143290 May 10 03:25:56.103782 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 477/933] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:25:55 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 1372 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 03:25:56.247804 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a217e8d4-1a13-4eeb-b905-f7d30e14c2f7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:56.248730 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-a217e8d4-1a13-4eeb-b905-f7d30e14c2f7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:56.255121 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a217e8d4-1a13-4eeb-b905-f7d30e14c2f7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:56.255746 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a217e8d4-1a13-4eeb-b905-f7d30e14c2f7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:56.256855 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a217e8d4-1a13-4eeb-b905-f7d30e14c2f7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:56.257455 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a217e8d4-1a13-4eeb-b905-f7d30e14c2f7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:56.327150 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-a217e8d4-1a13-4eeb-b905-f7d30e14c2f7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:56.339256 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-a217e8d4-1a13-4eeb-b905-f7d30e14c2f7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b" status: 200 len: 1279 microversion: 2.1 time: 0.094793 May 10 03:25:56.340919 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 457/934] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:56 2022] GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b => generated 1279 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:56.775855 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-0889b1e2-d480-4506-b4f0-9286728a0a06 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:56.776569 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-0889b1e2-d480-4506-b4f0-9286728a0a06 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] [instance: 70461bd7-372f-4190-bcea-c048ecdfc83a] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:56.782829 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0889b1e2-d480-4506-b4f0-9286728a0a06 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:56.783280 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0889b1e2-d480-4506-b4f0-9286728a0a06 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:56.784079 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0889b1e2-d480-4506-b4f0-9286728a0a06 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:56.784793 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0889b1e2-d480-4506-b4f0-9286728a0a06 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:56.855281 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-0889b1e2-d480-4506-b4f0-9286728a0a06 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285cbf50fac34905b72f620030429585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdd3106ad0d445fb9866648596f811e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:56.861600 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-0889b1e2-d480-4506-b4f0-9286728a0a06 tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] 10.222.0.65 "GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a" status: 200 len: 1462 microversion: 2.1 time: 0.089461 May 10 03:25:56.862188 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 478/935] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:56 2022] GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a => generated 1462 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:56.893841 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-9d83b6ff-7946-4876-b2f6-2b4373cfa909 req-8b241894-2fdf-45d1-aa50-625a76564cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70461bd7-372f-4190-bcea-c048ecdfc83a", "name": "network-vif-deleted", "tag": "3973e790-3cc6-4c24-a035-e7250209a2bc"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:25:56.901644 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-9d83b6ff-7946-4876-b2f6-2b4373cfa909 req-8b241894-2fdf-45d1-aa50-625a76564cda service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:56.902107 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-9d83b6ff-7946-4876-b2f6-2b4373cfa909 req-8b241894-2fdf-45d1-aa50-625a76564cda service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:56.912771 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-9d83b6ff-7946-4876-b2f6-2b4373cfa909 req-8b241894-2fdf-45d1-aa50-625a76564cda service nova] Creating event network-vif-deleted:3973e790-3cc6-4c24-a035-e7250209a2bc for instance 70461bd7-372f-4190-bcea-c048ecdfc83a on hv-cinder-83009 May 10 03:25:56.918296 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-9d83b6ff-7946-4876-b2f6-2b4373cfa909 req-8b241894-2fdf-45d1-aa50-625a76564cda service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028264 May 10 03:25:56.918889 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 458/936] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:25:57.122569 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-f3b4e31b-c3f1-4945-a504-741b4e76d0f9 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:57.123401 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-f3b4e31b-c3f1-4945-a504-741b4e76d0f9 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:57.129597 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f3b4e31b-c3f1-4945-a504-741b4e76d0f9 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:57.133199 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f3b4e31b-c3f1-4945-a504-741b4e76d0f9 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:57.133199 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f3b4e31b-c3f1-4945-a504-741b4e76d0f9 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:57.133199 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f3b4e31b-c3f1-4945-a504-741b4e76d0f9 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:57.150845 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-f3b4e31b-c3f1-4945-a504-741b4e76d0f9 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] HTTP exception thrown: Instance d490231e-628d-467d-a571-2538c3646f1e could not be found. May 10 03:25:57.155217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-f3b4e31b-c3f1-4945-a504-741b4e76d0f9 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Request method failure captured: May 10 03:25:57.155217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e HTTP/1.1 May 10 03:25:57.155217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:25:57.155217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:25:57.155217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:25:57.155217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:25:57.155217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:25:57.155217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:25:57.155217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:25:57.155217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:25:57.155217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedmxtzjD0M3YkUhs9pT9XXP7ZiMvWrInD5BgLVozFjRHZV_8pF1ggpVEsx6Orjjk2d7DFKJZHnRRe0RjzXh9dnnTPyVUueQjwI8ffRwX7ft9vPjWESZT3v0KSFBMM7VYsNfAYqSBoase0wDWRXyWNJPP7QYI3qQ6IlTXt6CLSUOYHOk May 10 03:25:57.155217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:25:57.155217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:25:57.155217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:25:57.155217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:25:57.155217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Openstack-Nova-Api-Version: 2.20 May 10 03:25:57.155217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:25:57.155217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:25:57.155217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: 4af328ed59384b70b2312c150a124746 May 10 03:25:57.155217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1289566836 May 10 03:25:57.155217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:25:57.155217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:25:57.156928 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4af328ed59384b70b2312c150a124746", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4af328ed59384b70b2312c150a124746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4af328ed59384b70b2312c150a124746"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4af328ed59384b70b2312c150a124746"}]}] May 10 03:25:57.156928 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1289566836 May 10 03:25:57.156928 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: 4af328ed59384b70b2312c150a124746 May 10 03:25:57.156928 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1289566836 May 10 03:25:57.156928 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-AttachVolumeShelveTestJSON-1289566836-project May 10 03:25:57.156928 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:25:57.156928 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:25:57.156928 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: 9dff947a164641e7b32c639bebbffe36 May 10 03:25:57.156928 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1289566836-project May 10 03:25:57.156928 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: > May 10 03:25:57.156928 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Instance d490231e-628d-467d-a571-2538c3646f1e could not be found. May 10 03:25:57.156928 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': 'd490231e-628d-467d-a571-2538c3646f1e'} May 10 03:25:57.157685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:25:57.157685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:57.157685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:25:57.157685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:25:57.157685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:25:57.157685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:25:57.157685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:25:57.157685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:25:57.157685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:25:57.157685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:25:57.157685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d490231e-628d-467d-a571-2538c3646f1e could not be found. May 10 03:25:57.157685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:57.157685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:57.157685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:57.157685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:57.157685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:57.157685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:57.157685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:25:57.157685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:25:57.157685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:25:57.158985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:25:57.158985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:25:57.158985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:25:57.158985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:25:57.158985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:25:57.158985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:25:57.158985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:25:57.158985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d490231e-628d-467d-a571-2538c3646f1e could not be found. May 10 03:25:57.158985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:57.158985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:57.158985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:57.158985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:57.158985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:57.158985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:57.158985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:25:57.158985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:25:57.158985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d490231e-628d-467d-a571-2538c3646f1e could not be found. May 10 03:25:57.158985 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:57.162018 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-f3b4e31b-c3f1-4945-a504-741b4e76d0f9 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Returning 404 to user: Instance d490231e-628d-467d-a571-2538c3646f1e could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:25:57.163114 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-f3b4e31b-c3f1-4945-a504-741b4e76d0f9 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 404 len: 111 microversion: 2.20 time: 0.044977 May 10 03:25:57.164563 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 479/937] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:25:57 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 03:25:57.179295 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-17ced556-512f-44fc-a597-1840ac0e569f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '.version_select at 0x7f6a5d3fd790>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:57.275174 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-17ced556-512f-44fc-a597-1840ac0e569f tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1810819989" status: 204 len: 0 microversion: 2.20 time: 0.105045 May 10 03:25:57.275771 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 459/938] 10.222.0.65 () {60 vars in 1261 bytes} [Tue May 10 03:25:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1810819989 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 03:25:57.356711 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-bae6ba16-fc09-4b70-8ac8-06a2de778423 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:57.357335 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-bae6ba16-fc09-4b70-8ac8-06a2de778423 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:57.363234 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bae6ba16-fc09-4b70-8ac8-06a2de778423 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:57.363688 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bae6ba16-fc09-4b70-8ac8-06a2de778423 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:57.364515 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bae6ba16-fc09-4b70-8ac8-06a2de778423 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:57.364959 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bae6ba16-fc09-4b70-8ac8-06a2de778423 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:57.500798 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-bae6ba16-fc09-4b70-8ac8-06a2de778423 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:57.512390 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-bae6ba16-fc09-4b70-8ac8-06a2de778423 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b" status: 200 len: 1319 microversion: 2.1 time: 0.160116 May 10 03:25:57.513236 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 480/939] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:57 2022] GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:57.879534 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-5fb141d2-bba1-4128-9a0d-8776ec980cec tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:57.880308 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-5fb141d2-bba1-4128-9a0d-8776ec980cec tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] [instance: 70461bd7-372f-4190-bcea-c048ecdfc83a] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:57.887721 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5fb141d2-bba1-4128-9a0d-8776ec980cec tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:57.888481 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5fb141d2-bba1-4128-9a0d-8776ec980cec tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:57.889435 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5fb141d2-bba1-4128-9a0d-8776ec980cec tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:57.889877 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-5fb141d2-bba1-4128-9a0d-8776ec980cec tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:57.903436 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-5fb141d2-bba1-4128-9a0d-8776ec980cec tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] HTTP exception thrown: Instance 70461bd7-372f-4190-bcea-c048ecdfc83a could not be found. May 10 03:25:57.905154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-5fb141d2-bba1-4128-9a0d-8776ec980cec tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Request method failure captured: May 10 03:25:57.905154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a HTTP/1.1 May 10 03:25:57.905154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:25:57.905154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:25:57.905154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:25:57.905154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:25:57.905154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:25:57.905154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:25:57.905154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:25:57.905154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:25:57.905154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedsuxyHO76imYPsvpYSKqWCtJvAnyYH_MWRQFzp3LahR_XWEWR69ezEOmiDglHLL9ZgwfwkpDR-vNkvkr__CLswT_xdtxpKWGqSv64vUK9yro749xb0B4JzM80xqTs3wyYcdnheu8fLjjQBiivuRgvFlrhxROissvyBqiXJY4__3VKU May 10 03:25:57.905154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:25:57.905154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:25:57.905154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:25:57.905154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:25:57.905154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:25:57.905154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:25:57.905154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: dfdd3106ad0d445fb9866648596f811e May 10 03:25:57.905154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-VolumesActionsTest-761811442 May 10 03:25:57.905154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:25:57.905154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:25:57.906782 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dfdd3106ad0d445fb9866648596f811e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dfdd3106ad0d445fb9866648596f811e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dfdd3106ad0d445fb9866648596f811e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dfdd3106ad0d445fb9866648596f811e"}]}] May 10 03:25:57.906782 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-VolumesActionsTest-761811442 May 10 03:25:57.906782 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: dfdd3106ad0d445fb9866648596f811e May 10 03:25:57.906782 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-VolumesActionsTest-761811442 May 10 03:25:57.906782 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-VolumesActionsTest-761811442-project May 10 03:25:57.906782 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:25:57.906782 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:25:57.906782 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: 285cbf50fac34905b72f620030429585 May 10 03:25:57.906782 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-VolumesActionsTest-761811442-project May 10 03:25:57.906782 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:25:57.906782 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Instance 70461bd7-372f-4190-bcea-c048ecdfc83a could not be found. May 10 03:25:57.906782 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'id': '70461bd7-372f-4190-bcea-c048ecdfc83a'} May 10 03:25:57.907703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:25:57.907703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:57.907703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:25:57.907703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:25:57.907703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:25:57.907703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:25:57.907703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:25:57.907703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:25:57.907703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:25:57.907703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:25:57.907703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70461bd7-372f-4190-bcea-c048ecdfc83a could not be found. May 10 03:25:57.907703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:57.907703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:57.907703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:57.907703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:57.907703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:57.907703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:57.907703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:25:57.907703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:25:57.907703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:25:57.909211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:25:57.909211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:25:57.909211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:25:57.909211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:25:57.909211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:25:57.909211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:25:57.909211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:25:57.909211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70461bd7-372f-4190-bcea-c048ecdfc83a could not be found. May 10 03:25:57.909211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:57.909211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:57.909211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:57.909211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:57.909211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:57.909211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:57.909211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:25:57.909211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:25:57.909211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70461bd7-372f-4190-bcea-c048ecdfc83a could not be found. May 10 03:25:57.909211 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:57.910474 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-5fb141d2-bba1-4128-9a0d-8776ec980cec tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] Returning 404 to user: Instance 70461bd7-372f-4190-bcea-c048ecdfc83a could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:25:57.910474 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-5fb141d2-bba1-4128-9a0d-8776ec980cec tempest-VolumesActionsTest-761811442 tempest-VolumesActionsTest-761811442-project] 10.222.0.65 "GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a" status: 404 len: 111 microversion: 2.1 time: 0.031689 May 10 03:25:57.910474 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 460/940] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:57 2022] GET /compute/v2.1/servers/70461bd7-372f-4190-bcea-c048ecdfc83a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:25:58.529230 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-5ccfd67f-84a9-4fdf-a1ba-7ee2edab0cb2 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:58.529833 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-5ccfd67f-84a9-4fdf-a1ba-7ee2edab0cb2 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:58.536312 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5ccfd67f-84a9-4fdf-a1ba-7ee2edab0cb2 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:58.536756 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5ccfd67f-84a9-4fdf-a1ba-7ee2edab0cb2 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:58.537516 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5ccfd67f-84a9-4fdf-a1ba-7ee2edab0cb2 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:58.537950 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-5ccfd67f-84a9-4fdf-a1ba-7ee2edab0cb2 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:58.688866 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-5ccfd67f-84a9-4fdf-a1ba-7ee2edab0cb2 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:58.696602 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-5ccfd67f-84a9-4fdf-a1ba-7ee2edab0cb2 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b" status: 200 len: 1319 microversion: 2.1 time: 0.170965 May 10 03:25:58.697278 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 481/941] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:58 2022] GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:25:58.941275 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-e9da1c11-800c-4fe6-96f4-9a619b9f9417 req-afca3ce1-fa7b-4b80-9d1d-eda92da341c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9280d0c1-8c42-414b-821f-12c9314bc50b", "tag": "72610399-4a51-40b7-b2b9-173be370b569"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:25:58.949891 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-e9da1c11-800c-4fe6-96f4-9a619b9f9417 req-afca3ce1-fa7b-4b80-9d1d-eda92da341c2 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:58.950363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-e9da1c11-800c-4fe6-96f4-9a619b9f9417 req-afca3ce1-fa7b-4b80-9d1d-eda92da341c2 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:58.961569 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-e9da1c11-800c-4fe6-96f4-9a619b9f9417 req-afca3ce1-fa7b-4b80-9d1d-eda92da341c2 service nova] Creating event network-changed:72610399-4a51-40b7-b2b9-173be370b569 for instance 9280d0c1-8c42-414b-821f-12c9314bc50b on hv-cinder-83009 May 10 03:25:58.967519 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-e9da1c11-800c-4fe6-96f4-9a619b9f9417 req-afca3ce1-fa7b-4b80-9d1d-eda92da341c2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029687 May 10 03:25:58.968154 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 461/942] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:25:59.370284 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-d086c40f-afcb-451c-b12c-31dad664493d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:59.370791 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-d086c40f-afcb-451c-b12c-31dad664493d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:59.376614 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d086c40f-afcb-451c-b12c-31dad664493d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:59.377058 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d086c40f-afcb-451c-b12c-31dad664493d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:59.377811 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d086c40f-afcb-451c-b12c-31dad664493d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:59.378241 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-d086c40f-afcb-451c-b12c-31dad664493d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:59.391994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-d086c40f-afcb-451c-b12c-31dad664493d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] HTTP exception thrown: Instance d490231e-628d-467d-a571-2538c3646f1e could not be found. May 10 03:25:59.393632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-d086c40f-afcb-451c-b12c-31dad664493d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Request method failure captured: May 10 03:25:59.393632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: DELETE /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e HTTP/1.1 May 10 03:25:59.393632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:25:59.393632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:25:59.393632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:25:59.393632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:25:59.393632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:25:59.393632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:25:59.393632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:25:59.393632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:25:59.393632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedmxtzjD0M3YkUhs9pT9XXP7ZiMvWrInD5BgLVozFjRHZV_8pF1ggpVEsx6Orjjk2d7DFKJZHnRRe0RjzXh9dnnTPyVUueQjwI8ffRwX7ft9vPjWESZT3v0KSFBMM7VYsNfAYqSBoase0wDWRXyWNJPP7QYI3qQ6IlTXt6CLSUOYHOk May 10 03:25:59.393632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:25:59.393632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:25:59.393632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:25:59.393632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:25:59.393632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Openstack-Nova-Api-Version: 2.20 May 10 03:25:59.393632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:25:59.393632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:25:59.393632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: 4af328ed59384b70b2312c150a124746 May 10 03:25:59.393632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1289566836 May 10 03:25:59.393632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:25:59.393632 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:25:59.395250 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4af328ed59384b70b2312c150a124746", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4af328ed59384b70b2312c150a124746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4af328ed59384b70b2312c150a124746"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4af328ed59384b70b2312c150a124746"}]}] May 10 03:25:59.395250 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1289566836 May 10 03:25:59.395250 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: 4af328ed59384b70b2312c150a124746 May 10 03:25:59.395250 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1289566836 May 10 03:25:59.395250 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-AttachVolumeShelveTestJSON-1289566836-project May 10 03:25:59.395250 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:25:59.395250 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:25:59.395250 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: 9dff947a164641e7b32c639bebbffe36 May 10 03:25:59.395250 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1289566836-project May 10 03:25:59.395250 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: > May 10 03:25:59.395250 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Instance d490231e-628d-467d-a571-2538c3646f1e could not be found. May 10 03:25:59.395250 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': 'd490231e-628d-467d-a571-2538c3646f1e'} May 10 03:25:59.396337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:25:59.396337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:59.396337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:25:59.396337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:25:59.396337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:25:59.396337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:25:59.396337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:25:59.396337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:25:59.396337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:25:59.396337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:25:59.396337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d490231e-628d-467d-a571-2538c3646f1e could not be found. May 10 03:25:59.396337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:59.396337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:59.396337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:59.396337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:59.396337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:59.396337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:59.396337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:25:59.396337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:25:59.396337 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:25:59.397994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:25:59.397994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:25:59.397994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:25:59.397994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:25:59.397994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:25:59.397994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:25:59.397994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:25:59.397994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:25:59.397994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:25:59.397994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d490231e-628d-467d-a571-2538c3646f1e could not be found. May 10 03:25:59.397994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:59.397994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:59.397994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:59.397994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:59.397994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:59.397994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:59.397994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:25:59.397994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:25:59.397994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d490231e-628d-467d-a571-2538c3646f1e could not be found. May 10 03:25:59.397994 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:25:59.399526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-d086c40f-afcb-451c-b12c-31dad664493d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Returning 404 to user: Instance d490231e-628d-467d-a571-2538c3646f1e could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:25:59.399526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-d086c40f-afcb-451c-b12c-31dad664493d tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 404 len: 111 microversion: 2.20 time: 0.029037 May 10 03:25:59.399526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 482/943] 10.222.0.65 () {60 vars in 1279 bytes} [Tue May 10 03:25:59 2022] DELETE /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 03:25:59.403887 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-3a2e16a3-e5d8-47d7-88e2-671c3001235b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:59.404586 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-3a2e16a3-e5d8-47d7-88e2-671c3001235b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: d490231e-628d-467d-a571-2538c3646f1e] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:59.410910 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3a2e16a3-e5d8-47d7-88e2-671c3001235b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:59.413712 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3a2e16a3-e5d8-47d7-88e2-671c3001235b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:59.413712 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3a2e16a3-e5d8-47d7-88e2-671c3001235b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:59.413712 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3a2e16a3-e5d8-47d7-88e2-671c3001235b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:59.426586 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-3a2e16a3-e5d8-47d7-88e2-671c3001235b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] HTTP exception thrown: Instance d490231e-628d-467d-a571-2538c3646f1e could not be found. May 10 03:25:59.428283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-3a2e16a3-e5d8-47d7-88e2-671c3001235b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Request method failure captured: May 10 03:25:59.428283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e HTTP/1.1 May 10 03:25:59.428283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:25:59.428283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:25:59.428283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:25:59.428283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:25:59.428283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:25:59.428283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:25:59.428283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:25:59.428283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:25:59.428283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedmxtzjD0M3YkUhs9pT9XXP7ZiMvWrInD5BgLVozFjRHZV_8pF1ggpVEsx6Orjjk2d7DFKJZHnRRe0RjzXh9dnnTPyVUueQjwI8ffRwX7ft9vPjWESZT3v0KSFBMM7VYsNfAYqSBoase0wDWRXyWNJPP7QYI3qQ6IlTXt6CLSUOYHOk May 10 03:25:59.428283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:25:59.428283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:25:59.428283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:25:59.428283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:25:59.428283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Openstack-Nova-Api-Version: 2.20 May 10 03:25:59.428283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:25:59.428283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:25:59.428283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: 4af328ed59384b70b2312c150a124746 May 10 03:25:59.428283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1289566836 May 10 03:25:59.428283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:25:59.428283 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:25:59.429925 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4af328ed59384b70b2312c150a124746", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4af328ed59384b70b2312c150a124746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4af328ed59384b70b2312c150a124746"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4af328ed59384b70b2312c150a124746"}]}] May 10 03:25:59.429925 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1289566836 May 10 03:25:59.429925 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: 4af328ed59384b70b2312c150a124746 May 10 03:25:59.429925 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1289566836 May 10 03:25:59.429925 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-AttachVolumeShelveTestJSON-1289566836-project May 10 03:25:59.429925 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:25:59.429925 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:25:59.429925 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: 9dff947a164641e7b32c639bebbffe36 May 10 03:25:59.429925 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1289566836-project May 10 03:25:59.429925 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:25:59.429925 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Instance d490231e-628d-467d-a571-2538c3646f1e could not be found. May 10 03:25:59.429925 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'id': 'd490231e-628d-467d-a571-2538c3646f1e'} May 10 03:25:59.430853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:25:59.430853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:59.430853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:25:59.430853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:25:59.430853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:25:59.430853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:25:59.430853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:25:59.430853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:25:59.430853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:25:59.430853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:25:59.430853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d490231e-628d-467d-a571-2538c3646f1e could not be found. May 10 03:25:59.430853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:59.430853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:59.430853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:59.430853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:59.430853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:59.430853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:59.430853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:25:59.430853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:25:59.430853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:25:59.432918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:25:59.432918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:25:59.432918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:25:59.432918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:25:59.432918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:25:59.432918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:25:59.432918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:25:59.432918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d490231e-628d-467d-a571-2538c3646f1e could not be found. May 10 03:25:59.432918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:59.432918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:25:59.432918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:59.432918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:25:59.432918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:25:59.432918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:25:59.432918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:25:59.432918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:25:59.432918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d490231e-628d-467d-a571-2538c3646f1e could not be found. May 10 03:25:59.432918 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:25:59.434593 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-3a2e16a3-e5d8-47d7-88e2-671c3001235b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Returning 404 to user: Instance d490231e-628d-467d-a571-2538c3646f1e could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:25:59.434593 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-3a2e16a3-e5d8-47d7-88e2-671c3001235b tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e" status: 404 len: 111 microversion: 2.20 time: 0.030055 May 10 03:25:59.434593 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 462/944] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:25:59 2022] GET /compute/v2.1/servers/d490231e-628d-467d-a571-2538c3646f1e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 03:25:59.713313 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c4af32d7-c125-410f-8dab-c6aa471ba7d4 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:25:59.713930 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-c4af32d7-c125-410f-8dab-c6aa471ba7d4 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:25:59.720238 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c4af32d7-c125-410f-8dab-c6aa471ba7d4 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:59.720690 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c4af32d7-c125-410f-8dab-c6aa471ba7d4 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:59.721464 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c4af32d7-c125-410f-8dab-c6aa471ba7d4 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:25:59.721900 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c4af32d7-c125-410f-8dab-c6aa471ba7d4 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:25:59.855495 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-c4af32d7-c125-410f-8dab-c6aa471ba7d4 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:25:59.866614 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-c4af32d7-c125-410f-8dab-c6aa471ba7d4 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b" status: 200 len: 1319 microversion: 2.1 time: 0.157105 May 10 03:25:59.867552 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 483/945] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:25:59 2022] GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:00.707556 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-64be1476-7ad0-4798-a483-c7b8eaa9cf31 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:00.708086 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-64be1476-7ad0-4798-a483-c7b8eaa9cf31 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:00.716301 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-64be1476-7ad0-4798-a483-c7b8eaa9cf31 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:00.717038 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-64be1476-7ad0-4798-a483-c7b8eaa9cf31 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:00.718225 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-64be1476-7ad0-4798-a483-c7b8eaa9cf31 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:00.718667 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-64be1476-7ad0-4798-a483-c7b8eaa9cf31 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:00.732734 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-64be1476-7ad0-4798-a483-c7b8eaa9cf31 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] HTTP exception thrown: Instance e8796004-8adb-4534-a094-c62dfd2a9636 could not be found. May 10 03:26:00.734297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-64be1476-7ad0-4798-a483-c7b8eaa9cf31 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Request method failure captured: May 10 03:26:00.734297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: DELETE /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 HTTP/1.1 May 10 03:26:00.734297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:26:00.734297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:26:00.734297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:26:00.734297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:26:00.734297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:26:00.734297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:26:00.734297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:26:00.734297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:26:00.734297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedmxtzjD0M3YkUhs9pT9XXP7ZiMvWrInD5BgLVozFjRHZV_8pF1ggpVEsx6Orjjk2d7DFKJZHnRRe0RjzXh9dnnTPyVUueQjwI8ffRwX7ft9vPjWESZT3v0KSFBMM7VYsNfAYqSBoase0wDWRXyWNJPP7QYI3qQ6IlTXt6CLSUOYHOk May 10 03:26:00.734297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:26:00.734297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:26:00.734297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:26:00.734297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:26:00.734297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Openstack-Nova-Api-Version: 2.20 May 10 03:26:00.734297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:26:00.734297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:26:00.734297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: 4af328ed59384b70b2312c150a124746 May 10 03:26:00.734297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1289566836 May 10 03:26:00.734297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:26:00.734297 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:26:00.735850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4af328ed59384b70b2312c150a124746", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4af328ed59384b70b2312c150a124746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4af328ed59384b70b2312c150a124746"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4af328ed59384b70b2312c150a124746"}]}] May 10 03:26:00.735850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1289566836 May 10 03:26:00.735850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: 4af328ed59384b70b2312c150a124746 May 10 03:26:00.735850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1289566836 May 10 03:26:00.735850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-AttachVolumeShelveTestJSON-1289566836-project May 10 03:26:00.735850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:26:00.735850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:26:00.735850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: 9dff947a164641e7b32c639bebbffe36 May 10 03:26:00.735850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1289566836-project May 10 03:26:00.735850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:26:00.735850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Instance e8796004-8adb-4534-a094-c62dfd2a9636 could not be found. May 10 03:26:00.735850 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'id': 'e8796004-8adb-4534-a094-c62dfd2a9636'} May 10 03:26:00.736718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:26:00.736718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:00.736718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:26:00.736718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:26:00.736718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:26:00.736718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:26:00.736718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:26:00.736718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:26:00.736718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:26:00.736718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:26:00.736718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8796004-8adb-4534-a094-c62dfd2a9636 could not be found. May 10 03:26:00.736718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:00.736718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:26:00.736718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:00.736718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:00.736718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:26:00.736718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:26:00.736718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:26:00.736718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:26:00.736718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:26:00.737957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:26:00.737957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 03:26:00.737957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 03:26:00.737957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 03:26:00.737957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 03:26:00.737957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:26:00.737957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:26:00.737957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:26:00.737957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:26:00.737957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8796004-8adb-4534-a094-c62dfd2a9636 could not be found. May 10 03:26:00.737957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:00.737957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:26:00.737957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:00.737957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:00.737957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:26:00.737957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:26:00.737957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:26:00.737957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:26:00.737957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8796004-8adb-4534-a094-c62dfd2a9636 could not be found. May 10 03:26:00.737957 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:00.739207 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-64be1476-7ad0-4798-a483-c7b8eaa9cf31 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Returning 404 to user: Instance e8796004-8adb-4534-a094-c62dfd2a9636 could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:26:00.739207 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-64be1476-7ad0-4798-a483-c7b8eaa9cf31 tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 404 len: 111 microversion: 2.20 time: 0.033054 May 10 03:26:00.739207 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 463/946] 10.222.0.65 () {60 vars in 1279 bytes} [Tue May 10 03:26:00 2022] DELETE /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 03:26:00.744860 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-aebf128d-29ef-4f1d-8599-b30a1aaac24a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:00.745465 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-aebf128d-29ef-4f1d-8599-b30a1aaac24a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] [instance: e8796004-8adb-4534-a094-c62dfd2a9636] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:00.751655 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-aebf128d-29ef-4f1d-8599-b30a1aaac24a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:00.752131 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-aebf128d-29ef-4f1d-8599-b30a1aaac24a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:00.752888 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-aebf128d-29ef-4f1d-8599-b30a1aaac24a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:00.753319 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-aebf128d-29ef-4f1d-8599-b30a1aaac24a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:00.768026 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-aebf128d-29ef-4f1d-8599-b30a1aaac24a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] HTTP exception thrown: Instance e8796004-8adb-4534-a094-c62dfd2a9636 could not be found. May 10 03:26:00.769526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-aebf128d-29ef-4f1d-8599-b30a1aaac24a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Request method failure captured: May 10 03:26:00.769526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 HTTP/1.1 May 10 03:26:00.769526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:26:00.769526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:26:00.769526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:26:00.769526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:26:00.769526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:26:00.769526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:26:00.769526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:26:00.769526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:26:00.769526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedmxtzjD0M3YkUhs9pT9XXP7ZiMvWrInD5BgLVozFjRHZV_8pF1ggpVEsx6Orjjk2d7DFKJZHnRRe0RjzXh9dnnTPyVUueQjwI8ffRwX7ft9vPjWESZT3v0KSFBMM7VYsNfAYqSBoase0wDWRXyWNJPP7QYI3qQ6IlTXt6CLSUOYHOk May 10 03:26:00.769526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:26:00.769526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:26:00.769526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:26:00.769526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:26:00.769526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Openstack-Nova-Api-Version: 2.20 May 10 03:26:00.769526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:26:00.769526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:26:00.769526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: 4af328ed59384b70b2312c150a124746 May 10 03:26:00.769526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1289566836 May 10 03:26:00.769526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:26:00.769526 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:26:00.771238 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4af328ed59384b70b2312c150a124746", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4af328ed59384b70b2312c150a124746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4af328ed59384b70b2312c150a124746"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4af328ed59384b70b2312c150a124746"}]}] May 10 03:26:00.771238 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1289566836 May 10 03:26:00.771238 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: 4af328ed59384b70b2312c150a124746 May 10 03:26:00.771238 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1289566836 May 10 03:26:00.771238 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-AttachVolumeShelveTestJSON-1289566836-project May 10 03:26:00.771238 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:26:00.771238 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:26:00.771238 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: 9dff947a164641e7b32c639bebbffe36 May 10 03:26:00.771238 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1289566836-project May 10 03:26:00.771238 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: > May 10 03:26:00.771238 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Instance e8796004-8adb-4534-a094-c62dfd2a9636 could not be found. May 10 03:26:00.771238 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': 'e8796004-8adb-4534-a094-c62dfd2a9636'} May 10 03:26:00.772379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:26:00.772379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:00.772379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:26:00.772379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:26:00.772379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:26:00.772379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:26:00.772379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:26:00.772379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:26:00.772379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:26:00.772379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:26:00.772379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8796004-8adb-4534-a094-c62dfd2a9636 could not be found. May 10 03:26:00.772379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:00.772379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:26:00.772379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:00.772379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:00.772379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:26:00.772379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:26:00.772379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:26:00.772379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:26:00.772379 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:26:00.773828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:26:00.773828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:26:00.773828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:26:00.773828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:26:00.773828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:26:00.773828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:26:00.773828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:26:00.773828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8796004-8adb-4534-a094-c62dfd2a9636 could not be found. May 10 03:26:00.773828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:00.773828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:26:00.773828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:00.773828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:00.773828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:26:00.773828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:26:00.773828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:26:00.773828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:26:00.773828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8796004-8adb-4534-a094-c62dfd2a9636 could not be found. May 10 03:26:00.773828 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:00.775277 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-aebf128d-29ef-4f1d-8599-b30a1aaac24a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] Returning 404 to user: Instance e8796004-8adb-4534-a094-c62dfd2a9636 could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:26:00.775277 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-aebf128d-29ef-4f1d-8599-b30a1aaac24a tempest-AttachVolumeShelveTestJSON-1289566836 tempest-AttachVolumeShelveTestJSON-1289566836-project] 10.222.0.65 "GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636" status: 404 len: 111 microversion: 2.20 time: 0.030221 May 10 03:26:00.775277 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 484/947] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 10 03:26:00 2022] GET /compute/v2.1/servers/e8796004-8adb-4534-a094-c62dfd2a9636 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 03:26:00.884489 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-dbd50e2b-1d86-4b7b-a33b-252d7389f78f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:00.885968 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-dbd50e2b-1d86-4b7b-a33b-252d7389f78f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:00.892121 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-dbd50e2b-1d86-4b7b-a33b-252d7389f78f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:00.892586 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-dbd50e2b-1d86-4b7b-a33b-252d7389f78f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:00.893369 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-dbd50e2b-1d86-4b7b-a33b-252d7389f78f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:00.893811 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-dbd50e2b-1d86-4b7b-a33b-252d7389f78f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:01.101252 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-dbd50e2b-1d86-4b7b-a33b-252d7389f78f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:01.109626 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-dbd50e2b-1d86-4b7b-a33b-252d7389f78f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b" status: 200 len: 1319 microversion: 2.1 time: 0.229281 May 10 03:26:01.110201 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 464/948] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:26:00 2022] GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:02.126407 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e65bc118-4273-4e09-aba1-d82394558c1f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:02.127014 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-e65bc118-4273-4e09-aba1-d82394558c1f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:02.133013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e65bc118-4273-4e09-aba1-d82394558c1f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:02.133459 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e65bc118-4273-4e09-aba1-d82394558c1f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:02.137100 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e65bc118-4273-4e09-aba1-d82394558c1f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:02.137100 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e65bc118-4273-4e09-aba1-d82394558c1f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:02.372821 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-e65bc118-4273-4e09-aba1-d82394558c1f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:02.384829 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-e65bc118-4273-4e09-aba1-d82394558c1f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b" status: 200 len: 1319 microversion: 2.1 time: 0.259284 May 10 03:26:02.384829 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 485/949] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:26:02 2022] GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:03.122724 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-9b6d2b7a-a7f8-4f26-a0ad-7b7bbe8b1384 req-15ebe2b4-0158-49fb-bda1-6d7368c0d701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9280d0c1-8c42-414b-821f-12c9314bc50b", "name": "network-vif-plugged", "status": "completed", "tag": "72610399-4a51-40b7-b2b9-173be370b569"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:26:03.131328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-9b6d2b7a-a7f8-4f26-a0ad-7b7bbe8b1384 req-15ebe2b4-0158-49fb-bda1-6d7368c0d701 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:03.132061 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-9b6d2b7a-a7f8-4f26-a0ad-7b7bbe8b1384 req-15ebe2b4-0158-49fb-bda1-6d7368c0d701 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:03.144368 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-9b6d2b7a-a7f8-4f26-a0ad-7b7bbe8b1384 req-15ebe2b4-0158-49fb-bda1-6d7368c0d701 service nova] Creating event network-vif-plugged:72610399-4a51-40b7-b2b9-173be370b569 for instance 9280d0c1-8c42-414b-821f-12c9314bc50b on hv-cinder-83009 May 10 03:26:03.149533 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-9b6d2b7a-a7f8-4f26-a0ad-7b7bbe8b1384 req-15ebe2b4-0158-49fb-bda1-6d7368c0d701 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031431 May 10 03:26:03.150198 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 465/950] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:26:03.399695 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-cfd6ebc0-36fa-4715-920e-8de56959c15a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:03.401328 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-cfd6ebc0-36fa-4715-920e-8de56959c15a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:03.408173 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-cfd6ebc0-36fa-4715-920e-8de56959c15a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:03.408863 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-cfd6ebc0-36fa-4715-920e-8de56959c15a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:03.409689 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-cfd6ebc0-36fa-4715-920e-8de56959c15a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:03.410129 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-cfd6ebc0-36fa-4715-920e-8de56959c15a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:03.580031 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-cfd6ebc0-36fa-4715-920e-8de56959c15a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:03.587654 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-cfd6ebc0-36fa-4715-920e-8de56959c15a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b" status: 200 len: 1319 microversion: 2.1 time: 0.192597 May 10 03:26:03.588258 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 486/951] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:26:03 2022] GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:04.605591 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-ff960767-f964-4c5c-99ad-bd1277c5a8c3 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:04.606220 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-ff960767-f964-4c5c-99ad-bd1277c5a8c3 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:04.612346 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ff960767-f964-4c5c-99ad-bd1277c5a8c3 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:04.612805 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ff960767-f964-4c5c-99ad-bd1277c5a8c3 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:04.613582 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ff960767-f964-4c5c-99ad-bd1277c5a8c3 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:04.614028 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ff960767-f964-4c5c-99ad-bd1277c5a8c3 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:04.854716 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ff960767-f964-4c5c-99ad-bd1277c5a8c3 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:04.862243 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-ff960767-f964-4c5c-99ad-bd1277c5a8c3 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b" status: 200 len: 1319 microversion: 2.1 time: 0.261410 May 10 03:26:04.862763 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 466/952] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:26:04 2022] GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:05.878612 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-3aa7deff-c1fa-448d-a85d-521c741e00d2 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:05.879266 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-3aa7deff-c1fa-448d-a85d-521c741e00d2 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:05.885648 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3aa7deff-c1fa-448d-a85d-521c741e00d2 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:05.886589 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3aa7deff-c1fa-448d-a85d-521c741e00d2 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:05.887472 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3aa7deff-c1fa-448d-a85d-521c741e00d2 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:05.888186 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3aa7deff-c1fa-448d-a85d-521c741e00d2 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:06.030005 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-3aa7deff-c1fa-448d-a85d-521c741e00d2 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:06.039095 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-3aa7deff-c1fa-448d-a85d-521c741e00d2 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b" status: 200 len: 1508 microversion: 2.1 time: 0.164336 May 10 03:26:06.039670 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 487/953] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:26:05 2022] GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:06.802666 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-cd265e94-303a-4afd-9d21-ac1f65f365c0 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] Action: 'create', calling method: .version_select at 0x7f6a5d0bad30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-638926543", "metadata": {"Type": "work"}}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:26:06.812432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-cd265e94-303a-4afd-9d21-ac1f65f365c0 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] Request method failure captured: May 10 03:26:06.812432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 03:26:06.812432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:26:06.812432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:26:06.812432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:26:06.812432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 121 May 10 03:26:06.812432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:26:06.812432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:26:06.812432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:26:06.812432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:26:06.812432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedtOKtx_ag3j3VOQUgIblWBs0Rl2J058rqb1HfUZpI20w8gXcpJgMU5n09OqCP7Ti3PTjc0qu_uD_PCIKZl91wYE29_xN_E4-h60GLd1v639GPhbnN1-yWt_y1rOMPWwJy06ccu62j9hsIgV0ekn99P301aNZmnqvE8RsvPAkBatAzo May 10 03:26:06.812432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:26:06.812432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:26:06.812432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:26:06.812432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:26:06.812432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:26:06.812432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:26:06.812432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: e0a8f97bcc70417e9609daad2c2d0ddf May 10 03:26:06.812432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-VolumesNegativeTest-2016771328 May 10 03:26:06.812432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:26:06.812432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:26:06.813804 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e0a8f97bcc70417e9609daad2c2d0ddf", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e0a8f97bcc70417e9609daad2c2d0ddf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e0a8f97bcc70417e9609daad2c2d0ddf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e0a8f97bcc70417e9609daad2c2d0ddf"}]}] May 10 03:26:06.813804 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-VolumesNegativeTest-2016771328 May 10 03:26:06.813804 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: e0a8f97bcc70417e9609daad2c2d0ddf May 10 03:26:06.813804 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-VolumesNegativeTest-2016771328 May 10 03:26:06.813804 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-VolumesNegativeTest-2016771328-project May 10 03:26:06.813804 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:26:06.813804 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:26:06.813804 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: 485728644b07453cac7bc38d2debc4c9 May 10 03:26:06.813804 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-VolumesNegativeTest-2016771328-project May 10 03:26:06.813804 dv-cinder-830094-4-smb devstack@n-api.service[117400]: May 10 03:26:06.813804 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-638926543", "metadata": {"Type": "work"}}} May 10 03:26:06.813804 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: May 10 03:26:06.813804 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 03:26:06.814659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-638926543', 'metadata': {'Type': 'work'}}}} May 10 03:26:06.814659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:26:06.814659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:06.814659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 03:26:06.814659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 03:26:06.814659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 03:26:06.814659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise error May 10 03:26:06.814659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 10 03:26:06.814659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:06.814659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 03:26:06.814659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 03:26:06.814659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:06.814659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 03:26:06.814659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi '#$%' May 10 03:26:06.814659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:06.814659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:26:06.814659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:06.814659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:06.814659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:26:06.814659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:26:06.814659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:26:06.814659 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:26:06.815987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 03:26:06.815987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 03:26:06.815987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:26:06.815987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:26:06.815987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 03:26:06.815987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 03:26:06.815987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 03:26:06.815987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 03:26:06.815987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 03:26:06.815987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 03:26:06.815987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 03:26:06.815987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:06.815987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:26:06.815987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:06.815987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:06.815987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:26:06.815987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:26:06.815987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 03:26:06.815987 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 03:26:06.820693 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 03:26:06.820693 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:06.820693 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-cd265e94-303a-4afd-9d21-ac1f65f365c0 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:26:06.820693 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-cd265e94-303a-4afd-9d21-ac1f65f365c0 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.234517 May 10 03:26:06.820693 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 467/954] 10.222.0.65 () {60 vars in 1155 bytes} [Tue May 10 03:26:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 236 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 03:26:06.823419 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-95da3992-0e55-4525-bdec-9df78ae9119a tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] Action: 'create', calling method: .version_select at 0x7f6a62db8040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1314105594", "metadata": {"Type": "work"}}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:26:06.826657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-95da3992-0e55-4525-bdec-9df78ae9119a tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] Request method failure captured: May 10 03:26:06.826657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 03:26:06.826657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:26:06.826657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:26:06.826657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:26:06.826657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 120 May 10 03:26:06.826657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:26:06.826657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:26:06.826657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:26:06.826657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:26:06.826657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedtOKtx_ag3j3VOQUgIblWBs0Rl2J058rqb1HfUZpI20w8gXcpJgMU5n09OqCP7Ti3PTjc0qu_uD_PCIKZl91wYE29_xN_E4-h60GLd1v639GPhbnN1-yWt_y1rOMPWwJy06ccu62j9hsIgV0ekn99P301aNZmnqvE8RsvPAkBatAzo May 10 03:26:06.826657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:26:06.826657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:26:06.826657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:26:06.826657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:26:06.826657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:26:06.826657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:26:06.826657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: e0a8f97bcc70417e9609daad2c2d0ddf May 10 03:26:06.826657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-VolumesNegativeTest-2016771328 May 10 03:26:06.826657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:26:06.826657 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:26:06.828242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e0a8f97bcc70417e9609daad2c2d0ddf", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e0a8f97bcc70417e9609daad2c2d0ddf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e0a8f97bcc70417e9609daad2c2d0ddf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e0a8f97bcc70417e9609daad2c2d0ddf"}]}] May 10 03:26:06.828242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-VolumesNegativeTest-2016771328 May 10 03:26:06.828242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: e0a8f97bcc70417e9609daad2c2d0ddf May 10 03:26:06.828242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-VolumesNegativeTest-2016771328 May 10 03:26:06.828242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-VolumesNegativeTest-2016771328-project May 10 03:26:06.828242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:26:06.828242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:26:06.828242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: 485728644b07453cac7bc38d2debc4c9 May 10 03:26:06.828242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-VolumesNegativeTest-2016771328-project May 10 03:26:06.828242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: May 10 03:26:06.828242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1314105594", "metadata": {"Type": "work"}}} May 10 03:26:06.828242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: May 10 03:26:06.828242 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 03:26:06.829619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1314105594', 'metadata': {'Type': 'work'}}}} May 10 03:26:06.829619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:26:06.829619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:06.829619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 03:26:06.829619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 03:26:06.829619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 03:26:06.829619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise error May 10 03:26:06.829619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 10 03:26:06.829619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:06.829619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 10 03:26:06.829619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 03:26:06.829619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:06.829619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 03:26:06.829619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi '0' May 10 03:26:06.829619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:06.829619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:26:06.829619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:06.829619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:06.829619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:26:06.829619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:26:06.829619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:26:06.829619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:26:06.831378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 03:26:06.831378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 03:26:06.831378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:26:06.831378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:26:06.831378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 03:26:06.831378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 03:26:06.831378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 03:26:06.831378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 03:26:06.831378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 03:26:06.831378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 03:26:06.831378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 03:26:06.831378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:06.831378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:26:06.831378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:06.831378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:06.831378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:26:06.831378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:26:06.831378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 03:26:06.831378 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 03:26:06.836715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 03:26:06.836715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:06.836715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-95da3992-0e55-4525-bdec-9df78ae9119a tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:26:06.836715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-95da3992-0e55-4525-bdec-9df78ae9119a tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008400 May 10 03:26:06.836715 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 488/955] 10.222.0.65 () {60 vars in 1155 bytes} [Tue May 10 03:26:06 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 03:26:06.837366 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-8d747671-330d-4cfa-9c91-a371bb336a80 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] Action: 'create', calling method: .version_select at 0x7f6a5d3fdca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2036832313", "metadata": {"Type": "work"}}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:26:06.839680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-8d747671-330d-4cfa-9c91-a371bb336a80 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] Request method failure captured: May 10 03:26:06.839680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 03:26:06.839680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:26:06.839680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:26:06.839680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:26:06.839680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 119 May 10 03:26:06.839680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:26:06.839680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:26:06.839680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:26:06.839680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:26:06.839680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedtOKtx_ag3j3VOQUgIblWBs0Rl2J058rqb1HfUZpI20w8gXcpJgMU5n09OqCP7Ti3PTjc0qu_uD_PCIKZl91wYE29_xN_E4-h60GLd1v639GPhbnN1-yWt_y1rOMPWwJy06ccu62j9hsIgV0ekn99P301aNZmnqvE8RsvPAkBatAzo May 10 03:26:06.839680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:26:06.839680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:26:06.839680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:26:06.839680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:26:06.839680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:26:06.839680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:26:06.839680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: e0a8f97bcc70417e9609daad2c2d0ddf May 10 03:26:06.839680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-VolumesNegativeTest-2016771328 May 10 03:26:06.839680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:26:06.839680 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:26:06.841290 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e0a8f97bcc70417e9609daad2c2d0ddf", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e0a8f97bcc70417e9609daad2c2d0ddf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e0a8f97bcc70417e9609daad2c2d0ddf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e0a8f97bcc70417e9609daad2c2d0ddf"}]}] May 10 03:26:06.841290 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-VolumesNegativeTest-2016771328 May 10 03:26:06.841290 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: e0a8f97bcc70417e9609daad2c2d0ddf May 10 03:26:06.841290 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-VolumesNegativeTest-2016771328 May 10 03:26:06.841290 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-VolumesNegativeTest-2016771328-project May 10 03:26:06.841290 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:26:06.841290 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:26:06.841290 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: 485728644b07453cac7bc38d2debc4c9 May 10 03:26:06.841290 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-VolumesNegativeTest-2016771328-project May 10 03:26:06.841290 dv-cinder-830094-4-smb devstack@n-api.service[117400]: May 10 03:26:06.841290 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2036832313", "metadata": {"Type": "work"}}} May 10 03:26:06.841290 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: May 10 03:26:06.841290 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 03:26:06.842460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2036832313', 'metadata': {'Type': 'work'}}}} May 10 03:26:06.842460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:26:06.842460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:06.842460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 03:26:06.842460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 03:26:06.842460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 03:26:06.842460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise error May 10 03:26:06.842460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 10 03:26:06.842460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:06.842460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 03:26:06.842460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 03:26:06.842460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:06.842460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 03:26:06.842460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi '' May 10 03:26:06.842460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:06.842460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:26:06.842460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:06.842460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:06.842460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:26:06.842460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:26:06.842460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:26:06.842460 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:26:06.844484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 03:26:06.844484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 03:26:06.844484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:26:06.844484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:26:06.844484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 03:26:06.844484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 03:26:06.844484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 03:26:06.844484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 03:26:06.844484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 03:26:06.844484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 03:26:06.844484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 03:26:06.844484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:06.844484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:26:06.844484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:06.844484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:06.844484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:26:06.844484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:26:06.844484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 03:26:06.844484 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 03:26:06.845891 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 03:26:06.845891 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:06.845891 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-8d747671-330d-4cfa-9c91-a371bb336a80 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:26:06.845891 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-8d747671-330d-4cfa-9c91-a371bb336a80 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007450 May 10 03:26:06.845891 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 468/956] 10.222.0.65 () {60 vars in 1155 bytes} [Tue May 10 03:26:06 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 03:26:06.849574 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ee4bf471-4bc9-46be-8831-e1bad081aef0 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] Calling method '.version_select at 0x7f6a5d9cf3a0>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:06.877139 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-ee4bf471-4bc9-46be-8831-e1bad081aef0 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] HTTP exception thrown: Volume tempest-invalid-807326542 could not be found. May 10 03:26:06.879090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ee4bf471-4bc9-46be-8831-e1bad081aef0 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] Request method failure captured: May 10 03:26:06.879090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-807326542 HTTP/1.1 May 10 03:26:06.879090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:26:06.879090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:26:06.879090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:26:06.879090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:26:06.879090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:26:06.879090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:26:06.879090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:26:06.879090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:26:06.879090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedtOKtx_ag3j3VOQUgIblWBs0Rl2J058rqb1HfUZpI20w8gXcpJgMU5n09OqCP7Ti3PTjc0qu_uD_PCIKZl91wYE29_xN_E4-h60GLd1v639GPhbnN1-yWt_y1rOMPWwJy06ccu62j9hsIgV0ekn99P301aNZmnqvE8RsvPAkBatAzo May 10 03:26:06.879090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:26:06.879090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:26:06.879090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:26:06.879090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:26:06.879090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:26:06.879090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:26:06.879090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: e0a8f97bcc70417e9609daad2c2d0ddf May 10 03:26:06.879090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-VolumesNegativeTest-2016771328 May 10 03:26:06.879090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:26:06.879090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:26:06.881046 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e0a8f97bcc70417e9609daad2c2d0ddf", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e0a8f97bcc70417e9609daad2c2d0ddf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e0a8f97bcc70417e9609daad2c2d0ddf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e0a8f97bcc70417e9609daad2c2d0ddf"}]}] May 10 03:26:06.881046 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-VolumesNegativeTest-2016771328 May 10 03:26:06.881046 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: e0a8f97bcc70417e9609daad2c2d0ddf May 10 03:26:06.881046 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-VolumesNegativeTest-2016771328 May 10 03:26:06.881046 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-VolumesNegativeTest-2016771328-project May 10 03:26:06.881046 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:26:06.881046 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:26:06.881046 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: 485728644b07453cac7bc38d2debc4c9 May 10 03:26:06.881046 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-VolumesNegativeTest-2016771328-project May 10 03:26:06.881046 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: May 10 03:26:06.881046 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Volume tempest-invalid-807326542 could not be found. May 10 03:26:06.881046 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': 'tempest-invalid-807326542'} May 10 03:26:06.881046 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:26:06.882136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:06.882136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:26:06.882136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:26:06.882136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 03:26:06.882136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 03:26:06.882136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 03:26:06.882136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 03:26:06.882136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 03:26:06.882136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 03:26:06.882136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 03:26:06.882136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 03:26:06.882136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:26:06.882136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:26:06.882136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:26:06.882136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:26:06.882136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-807326542 could not be found. (HTTP 404) (Request-ID: req-c95610c8-2158-48b9-b3cb-84277e23d7cc) May 10 03:26:06.882136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:06.882136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:26:06.882136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:06.883927 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:06.883927 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 03:26:06.883927 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 03:26:06.883927 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 03:26:06.883927 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 03:26:06.883927 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 03:26:06.883927 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 03:26:06.883927 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 03:26:06.883927 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 03:26:06.883927 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:26:06.883927 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:26:06.883927 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 03:26:06.883927 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 03:26:06.883927 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 03:26:06.883927 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 03:26:06.883927 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 03:26:06.883927 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 03:26:06.883927 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 03:26:06.883927 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 03:26:06.886101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:26:06.886101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:26:06.886101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:26:06.886101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:26:06.886101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-807326542 could not be found. May 10 03:26:06.886101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:06.886101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:26:06.886101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:06.886101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:06.886101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:26:06.886101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:26:06.886101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:26:06.886101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:26:06.886101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 03:26:06.886101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 03:26:06.886101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:26:06.886101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:26:06.886101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 03:26:06.886101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:26:06.886101 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-807326542 could not be found. May 10 03:26:06.887515 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:06.887515 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:26:06.887515 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:06.887515 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:06.887515 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:26:06.887515 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:26:06.887515 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:26:06.887515 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:26:06.887515 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-807326542 could not be found. May 10 03:26:06.887515 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:06.887515 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ee4bf471-4bc9-46be-8831-e1bad081aef0 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] Returning 404 to user: Volume tempest-invalid-807326542 could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:26:06.887515 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ee4bf471-4bc9-46be-8831-e1bad081aef0 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/tempest-invalid-807326542" status: 404 len: 98 microversion: 2.1 time: 0.034573 May 10 03:26:06.887515 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 489/957] 10.222.0.65 () {58 vars in 1214 bytes} [Tue May 10 03:26:06 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-807326542 => generated 98 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 03:26:06.890901 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-fe8a0177-9820-436a-982e-d2e078f48cf8 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003654 May 10 03:26:06.891396 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 469/958] 10.222.0.65 () {58 vars in 1139 bytes} [Tue May 10 03:26:06 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 03:26:06.901113 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-7804fffc-cde5-4221-a407-68c78ce6deff tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004143 May 10 03:26:06.902154 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 490/959] 10.222.0.65 () {58 vars in 1136 bytes} [Tue May 10 03:26:06 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 03:26:06.909776 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-9e6cc3db-b554-41f1-8a29-b8effc3275d2 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] Calling method '.version_select at 0x7f6a5d3fd040>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:06.946249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-9e6cc3db-b554-41f1-8a29-b8effc3275d2 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] HTTP exception thrown: Volume d98246e9-d49e-4fd8-9ed2-e9b074950712 could not be found. May 10 03:26:06.948728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-9e6cc3db-b554-41f1-8a29-b8effc3275d2 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] Request method failure captured: May 10 03:26:06.948728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: DELETE /compute/v2.1/os-volumes/d98246e9-d49e-4fd8-9ed2-e9b074950712 HTTP/1.1 May 10 03:26:06.948728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:26:06.948728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:26:06.948728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:26:06.948728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:26:06.948728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:26:06.948728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:26:06.948728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:26:06.948728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:26:06.948728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedtOKtx_ag3j3VOQUgIblWBs0Rl2J058rqb1HfUZpI20w8gXcpJgMU5n09OqCP7Ti3PTjc0qu_uD_PCIKZl91wYE29_xN_E4-h60GLd1v639GPhbnN1-yWt_y1rOMPWwJy06ccu62j9hsIgV0ekn99P301aNZmnqvE8RsvPAkBatAzo May 10 03:26:06.948728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:26:06.948728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:26:06.948728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:26:06.948728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:26:06.948728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:26:06.948728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:26:06.948728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: e0a8f97bcc70417e9609daad2c2d0ddf May 10 03:26:06.948728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-VolumesNegativeTest-2016771328 May 10 03:26:06.948728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:26:06.948728 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:26:06.950359 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e0a8f97bcc70417e9609daad2c2d0ddf", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e0a8f97bcc70417e9609daad2c2d0ddf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e0a8f97bcc70417e9609daad2c2d0ddf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e0a8f97bcc70417e9609daad2c2d0ddf"}]}] May 10 03:26:06.950359 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-VolumesNegativeTest-2016771328 May 10 03:26:06.950359 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: e0a8f97bcc70417e9609daad2c2d0ddf May 10 03:26:06.950359 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-VolumesNegativeTest-2016771328 May 10 03:26:06.950359 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-VolumesNegativeTest-2016771328-project May 10 03:26:06.950359 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:26:06.950359 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:26:06.950359 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: 485728644b07453cac7bc38d2debc4c9 May 10 03:26:06.950359 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-VolumesNegativeTest-2016771328-project May 10 03:26:06.950359 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: May 10 03:26:06.950359 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Volume d98246e9-d49e-4fd8-9ed2-e9b074950712 could not be found. May 10 03:26:06.950359 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'id': 'd98246e9-d49e-4fd8-9ed2-e9b074950712'} May 10 03:26:06.950359 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:26:06.951286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:06.951286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:26:06.951286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:26:06.951286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 03:26:06.951286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 03:26:06.951286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 03:26:06.951286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 03:26:06.951286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 03:26:06.951286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 03:26:06.951286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 03:26:06.951286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 03:26:06.951286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:26:06.951286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:26:06.951286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:26:06.951286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:26:06.951286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d98246e9-d49e-4fd8-9ed2-e9b074950712 could not be found. (HTTP 404) (Request-ID: req-b556da2a-a6d2-4293-8f56-cc6f37166d30) May 10 03:26:06.951286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:06.951286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:26:06.951286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:06.957780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:06.957780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 03:26:06.957780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 03:26:06.957780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 03:26:06.957780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 03:26:06.957780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 03:26:06.957780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 03:26:06.957780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 03:26:06.957780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 03:26:06.957780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:26:06.957780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:26:06.957780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 03:26:06.957780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 03:26:06.957780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 03:26:06.957780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 03:26:06.957780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 03:26:06.957780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 03:26:06.957780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 03:26:06.957780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 03:26:06.959159 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:26:06.959159 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:26:06.959159 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:26:06.959159 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:26:06.959159 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d98246e9-d49e-4fd8-9ed2-e9b074950712 could not be found. May 10 03:26:06.959159 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:06.959159 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:26:06.959159 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:06.959159 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:06.959159 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:26:06.959159 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:26:06.959159 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:26:06.959159 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:26:06.959159 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 03:26:06.959159 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 03:26:06.959159 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:26:06.959159 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:26:06.959159 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 03:26:06.959159 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:26:06.960668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d98246e9-d49e-4fd8-9ed2-e9b074950712 could not be found. May 10 03:26:06.960668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:06.960668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:26:06.960668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:06.960668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:06.960668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:26:06.960668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:26:06.960668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:26:06.960668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:26:06.960668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d98246e9-d49e-4fd8-9ed2-e9b074950712 could not be found. May 10 03:26:06.960668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:06.960668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-9e6cc3db-b554-41f1-8a29-b8effc3275d2 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] Returning 404 to user: Volume d98246e9-d49e-4fd8-9ed2-e9b074950712 could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:26:06.960668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-9e6cc3db-b554-41f1-8a29-b8effc3275d2 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/d98246e9-d49e-4fd8-9ed2-e9b074950712" status: 404 len: 109 microversion: 2.1 time: 0.043795 May 10 03:26:06.960668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 470/960] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 10 03:26:06 2022] DELETE /compute/v2.1/os-volumes/d98246e9-d49e-4fd8-9ed2-e9b074950712 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:26:06.961865 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-25ea0e04-6346-4705-9188-68eda1aff292 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] Calling method '.version_select at 0x7f6a62d97a60>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:06.989519 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-25ea0e04-6346-4705-9188-68eda1aff292 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] HTTP exception thrown: Volume 03f3b009-ef1f-4d22-b8a8-99570a323658 could not be found. May 10 03:26:06.991488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-25ea0e04-6346-4705-9188-68eda1aff292 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] Request method failure captured: May 10 03:26:06.991488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: GET /compute/v2.1/os-volumes/03f3b009-ef1f-4d22-b8a8-99570a323658 HTTP/1.1 May 10 03:26:06.991488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:26:06.991488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:26:06.991488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:26:06.991488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:26:06.991488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:26:06.991488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:26:06.991488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:26:06.991488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:26:06.991488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedtOKtx_ag3j3VOQUgIblWBs0Rl2J058rqb1HfUZpI20w8gXcpJgMU5n09OqCP7Ti3PTjc0qu_uD_PCIKZl91wYE29_xN_E4-h60GLd1v639GPhbnN1-yWt_y1rOMPWwJy06ccu62j9hsIgV0ekn99P301aNZmnqvE8RsvPAkBatAzo May 10 03:26:06.991488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:26:06.991488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:26:06.991488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:26:06.991488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:26:06.991488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:26:06.991488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:26:06.991488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: e0a8f97bcc70417e9609daad2c2d0ddf May 10 03:26:06.991488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-VolumesNegativeTest-2016771328 May 10 03:26:06.991488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:26:06.991488 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:26:06.993038 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e0a8f97bcc70417e9609daad2c2d0ddf", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e0a8f97bcc70417e9609daad2c2d0ddf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e0a8f97bcc70417e9609daad2c2d0ddf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e0a8f97bcc70417e9609daad2c2d0ddf"}]}] May 10 03:26:06.993038 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-VolumesNegativeTest-2016771328 May 10 03:26:06.993038 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: e0a8f97bcc70417e9609daad2c2d0ddf May 10 03:26:06.993038 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-VolumesNegativeTest-2016771328 May 10 03:26:06.993038 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-VolumesNegativeTest-2016771328-project May 10 03:26:06.993038 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:26:06.993038 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:26:06.993038 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: 485728644b07453cac7bc38d2debc4c9 May 10 03:26:06.993038 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-VolumesNegativeTest-2016771328-project May 10 03:26:06.993038 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: May 10 03:26:06.993038 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Volume 03f3b009-ef1f-4d22-b8a8-99570a323658 could not be found. May 10 03:26:06.993038 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': '03f3b009-ef1f-4d22-b8a8-99570a323658'} May 10 03:26:06.993038 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:26:06.994169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:06.994169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:26:06.994169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:26:06.994169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 03:26:06.994169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 03:26:06.994169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 03:26:06.994169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 03:26:06.994169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 03:26:06.994169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 03:26:06.994169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 03:26:06.994169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 03:26:06.994169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:26:06.994169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:26:06.994169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:26:06.994169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:26:06.994169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 03f3b009-ef1f-4d22-b8a8-99570a323658 could not be found. (HTTP 404) (Request-ID: req-881dc303-313b-4b01-b1c8-0df38eeb127a) May 10 03:26:06.994169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:06.994169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:26:06.994169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:06.995543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:06.995543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 03:26:06.995543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 03:26:06.995543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 03:26:06.995543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 03:26:06.995543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 03:26:06.995543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 03:26:06.995543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 03:26:06.995543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 03:26:06.995543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 03:26:06.995543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 03:26:06.995543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 03:26:06.995543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 03:26:06.995543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 03:26:06.995543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 03:26:06.995543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 03:26:06.995543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 03:26:06.995543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 03:26:06.995543 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 03:26:06.997965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 03:26:06.997965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 03:26:06.997965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 03:26:06.997965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 03:26:06.997965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 03f3b009-ef1f-4d22-b8a8-99570a323658 could not be found. May 10 03:26:06.997965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:06.997965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:26:06.997965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:06.997965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:06.997965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:26:06.997965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:26:06.997965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:26:06.997965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:26:06.997965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 03:26:06.997965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 03:26:06.997965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:26:06.997965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:26:06.997965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 03:26:06.997965 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:26:06.999326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 03f3b009-ef1f-4d22-b8a8-99570a323658 could not be found. May 10 03:26:06.999326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:06.999326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:26:06.999326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:06.999326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:06.999326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:26:06.999326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:26:06.999326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:26:06.999326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:26:06.999326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 03f3b009-ef1f-4d22-b8a8-99570a323658 could not be found. May 10 03:26:06.999326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:26:06.999326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-25ea0e04-6346-4705-9188-68eda1aff292 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] Returning 404 to user: Volume 03f3b009-ef1f-4d22-b8a8-99570a323658 could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:26:06.999326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-25ea0e04-6346-4705-9188-68eda1aff292 tempest-VolumesNegativeTest-2016771328 tempest-VolumesNegativeTest-2016771328-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/03f3b009-ef1f-4d22-b8a8-99570a323658" status: 404 len: 109 microversion: 2.1 time: 0.036891 May 10 03:26:06.999326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 491/961] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 10 03:26:06 2022] GET /compute/v2.1/os-volumes/03f3b009-ef1f-4d22-b8a8-99570a323658 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:26:20.746286 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-50cddc9d-4031-42bc-b356-6f443e1b87f5 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "225c0f05-9dab-4697-83d6-af277df3a3f8", "device": "/dev/sdb"}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:26:20.749899 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-50cddc9d-4031-42bc-b356-6f443e1b87f5 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:20.765668 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-50cddc9d-4031-42bc-b356-6f443e1b87f5 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:20.766125 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-50cddc9d-4031-42bc-b356-6f443e1b87f5 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:20.767001 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-50cddc9d-4031-42bc-b356-6f443e1b87f5 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:20.767482 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-50cddc9d-4031-42bc-b356-6f443e1b87f5 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:21.581224 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-50cddc9d-4031-42bc-b356-6f443e1b87f5 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "POST /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.840792 May 10 03:26:21.582021 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 471/962] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 03:26:20 2022] POST /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b/os-volume_attachments => generated 194 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:26:25.655571 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-08c4a072-5249-4142-b8e9-521b3ec2fbbb req-459e51d8-1f6b-440e-8c2f-284fc3ed1450 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "225c0f05-9dab-4697-83d6-af277df3a3f8", "create_info": {"type": "qcow2", "new_file": "volume-225c0f05-9dab-4697-83d6-af277df3a3f8.2c940f78-dc9a-445f-a017-46cd4a56d19a.vhdx", "snapshot_id": "2c940f78-dc9a-445f-a017-46cd4a56d19a"}}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:26:25.662852 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [req-08c4a072-5249-4142-b8e9-521b3ec2fbbb req-459e51d8-1f6b-440e-8c2f-284fc3ed1450 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e40af967-83ea-437d-8987-bd41fe271b3a(cell1) {{(pid=117399) load_cells /opt/stack/nova/nova/compute/api.py:306}} May 10 03:26:25.663421 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-08c4a072-5249-4142-b8e9-521b3ec2fbbb req-459e51d8-1f6b-440e-8c2f-284fc3ed1450 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:25.667877 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-08c4a072-5249-4142-b8e9-521b3ec2fbbb req-459e51d8-1f6b-440e-8c2f-284fc3ed1450 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:25.704365 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-08c4a072-5249-4142-b8e9-521b3ec2fbbb req-459e51d8-1f6b-440e-8c2f-284fc3ed1450 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:25.704815 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-08c4a072-5249-4142-b8e9-521b3ec2fbbb req-459e51d8-1f6b-440e-8c2f-284fc3ed1450 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:25.727217 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-08c4a072-5249-4142-b8e9-521b3ec2fbbb req-459e51d8-1f6b-440e-8c2f-284fc3ed1450 admin admin] 10.222.0.61 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.192061 May 10 03:26:25.728075 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 492/963] 10.222.0.61 () {64 vars in 1326 bytes} [Tue May 10 03:26:25 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:26:30.071148 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-3f9b3a66-4714-4dc6-869a-adeb00b8984a req-d6930bf2-7511-46bc-84f8-d353816eee7f admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "225c0f05-9dab-4697-83d6-af277df3a3f8", "create_info": {"type": "qcow2", "new_file": "volume-225c0f05-9dab-4697-83d6-af277df3a3f8.d8a605d5-49c6-4033-aa07-b472d8e5a47b.vhdx", "snapshot_id": "d8a605d5-49c6-4033-aa07-b472d8e5a47b"}}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:26:30.078454 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [req-3f9b3a66-4714-4dc6-869a-adeb00b8984a req-d6930bf2-7511-46bc-84f8-d353816eee7f admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e40af967-83ea-437d-8987-bd41fe271b3a(cell1) {{(pid=117400) load_cells /opt/stack/nova/nova/compute/api.py:306}} May 10 03:26:30.078992 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-3f9b3a66-4714-4dc6-869a-adeb00b8984a req-d6930bf2-7511-46bc-84f8-d353816eee7f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:30.079429 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-3f9b3a66-4714-4dc6-869a-adeb00b8984a req-d6930bf2-7511-46bc-84f8-d353816eee7f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:30.112078 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-3f9b3a66-4714-4dc6-869a-adeb00b8984a req-d6930bf2-7511-46bc-84f8-d353816eee7f admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:30.112522 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-3f9b3a66-4714-4dc6-869a-adeb00b8984a req-d6930bf2-7511-46bc-84f8-d353816eee7f admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:30.134363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-3f9b3a66-4714-4dc6-869a-adeb00b8984a req-d6930bf2-7511-46bc-84f8-d353816eee7f admin admin] 10.222.0.61 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.178216 May 10 03:26:30.134938 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 472/964] 10.222.0.61 () {64 vars in 1326 bytes} [Tue May 10 03:26:29 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:26:33.499089 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-68c1ce16-e3e9-4a14-9a24-05afb7b57d5e req-f73c7d78-75c8-493a-ae9e-e109ef329a5d admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "225c0f05-9dab-4697-83d6-af277df3a3f8", "create_info": {"type": "qcow2", "new_file": "volume-225c0f05-9dab-4697-83d6-af277df3a3f8.c2230c0f-4db5-494f-8efa-5a70b411f96d.vhdx", "snapshot_id": "c2230c0f-4db5-494f-8efa-5a70b411f96d"}}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:26:33.501298 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-68c1ce16-e3e9-4a14-9a24-05afb7b57d5e req-f73c7d78-75c8-493a-ae9e-e109ef329a5d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:33.502501 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-68c1ce16-e3e9-4a14-9a24-05afb7b57d5e req-f73c7d78-75c8-493a-ae9e-e109ef329a5d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:33.510851 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-68c1ce16-e3e9-4a14-9a24-05afb7b57d5e req-f73c7d78-75c8-493a-ae9e-e109ef329a5d admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:33.511360 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-68c1ce16-e3e9-4a14-9a24-05afb7b57d5e req-f73c7d78-75c8-493a-ae9e-e109ef329a5d admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:33.529346 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-68c1ce16-e3e9-4a14-9a24-05afb7b57d5e req-f73c7d78-75c8-493a-ae9e-e109ef329a5d admin admin] 10.222.0.61 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.167404 May 10 03:26:33.530043 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 493/965] 10.222.0.61 () {64 vars in 1326 bytes} [Tue May 10 03:26:33 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:26:36.834831 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-2063d933-9310-4cf2-98b6-cc662606714b req-e2dc9173-24ba-49f2-a5ea-3a34ca67d706 admin admin] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:36.838851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-2063d933-9310-4cf2-98b6-cc662606714b req-e2dc9173-24ba-49f2-a5ea-3a34ca67d706 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:36.838851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-2063d933-9310-4cf2-98b6-cc662606714b req-e2dc9173-24ba-49f2-a5ea-3a34ca67d706 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:36.845971 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-2063d933-9310-4cf2-98b6-cc662606714b req-e2dc9173-24ba-49f2-a5ea-3a34ca67d706 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:36.846423 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-2063d933-9310-4cf2-98b6-cc662606714b req-e2dc9173-24ba-49f2-a5ea-3a34ca67d706 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:36.859443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-2063d933-9310-4cf2-98b6-cc662606714b req-e2dc9173-24ba-49f2-a5ea-3a34ca67d706 admin admin] 10.222.0.61 "DELETE /compute/v2.1/os-assisted-volume-snapshots/2c940f78-dc9a-445f-a017-46cd4a56d19a?delete_info=%7B%22file_to_merge%22:%20%22volume-225c0f05-9dab-4697-83d6-af277df3a3f8.2c940f78-dc9a-445f-a017-46cd4a56d19a.vhdx%22,%20%22volume_id%22:%20%22225c0f05-9dab-4697-83d6-af277df3a3f8%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.142710 May 10 03:26:36.860066 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 473/966] 10.222.0.61 () {62 vars in 1800 bytes} [Tue May 10 03:26:36 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/2c940f78-dc9a-445f-a017-46cd4a56d19a?delete_info=%7B%22file_to_merge%22:%20%22volume-225c0f05-9dab-4697-83d6-af277df3a3f8.2c940f78-dc9a-445f-a017-46cd4a56d19a.vhdx%22,%20%22volume_id%22:%20%22225c0f05-9dab-4697-83d6-af277df3a3f8%22%7D => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:26:39.993835 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-7319e2e7-25bc-4cdb-9635-e1a17eea64c5 req-566b442f-0ef5-418b-98ba-1cc422714162 admin admin] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:39.995845 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-7319e2e7-25bc-4cdb-9635-e1a17eea64c5 req-566b442f-0ef5-418b-98ba-1cc422714162 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:39.996315 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-7319e2e7-25bc-4cdb-9635-e1a17eea64c5 req-566b442f-0ef5-418b-98ba-1cc422714162 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:40.007681 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-7319e2e7-25bc-4cdb-9635-e1a17eea64c5 req-566b442f-0ef5-418b-98ba-1cc422714162 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:40.008344 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-7319e2e7-25bc-4cdb-9635-e1a17eea64c5 req-566b442f-0ef5-418b-98ba-1cc422714162 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:40.030977 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-7319e2e7-25bc-4cdb-9635-e1a17eea64c5 req-566b442f-0ef5-418b-98ba-1cc422714162 admin admin] 10.222.0.61 "DELETE /compute/v2.1/os-assisted-volume-snapshots/c2230c0f-4db5-494f-8efa-5a70b411f96d?delete_info=%7B%22file_to_merge%22:%20%22volume-225c0f05-9dab-4697-83d6-af277df3a3f8.c2230c0f-4db5-494f-8efa-5a70b411f96d.vhdx%22,%20%22volume_id%22:%20%22225c0f05-9dab-4697-83d6-af277df3a3f8%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.088772 May 10 03:26:40.030977 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 494/967] 10.222.0.61 () {62 vars in 1800 bytes} [Tue May 10 03:26:39 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/c2230c0f-4db5-494f-8efa-5a70b411f96d?delete_info=%7B%22file_to_merge%22:%20%22volume-225c0f05-9dab-4697-83d6-af277df3a3f8.c2230c0f-4db5-494f-8efa-5a70b411f96d.vhdx%22,%20%22volume_id%22:%20%22225c0f05-9dab-4697-83d6-af277df3a3f8%22%7D => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 03:26:43.497812 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-46a66b9e-0cf7-498a-8b27-619b5261cdb2 req-f5708abb-8427-437c-8cc5-e7ef80dd2e75 admin admin] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:43.500194 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-46a66b9e-0cf7-498a-8b27-619b5261cdb2 req-f5708abb-8427-437c-8cc5-e7ef80dd2e75 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:43.500632 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-46a66b9e-0cf7-498a-8b27-619b5261cdb2 req-f5708abb-8427-437c-8cc5-e7ef80dd2e75 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:43.511233 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-46a66b9e-0cf7-498a-8b27-619b5261cdb2 req-f5708abb-8427-437c-8cc5-e7ef80dd2e75 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:43.511820 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-46a66b9e-0cf7-498a-8b27-619b5261cdb2 req-f5708abb-8427-437c-8cc5-e7ef80dd2e75 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:43.526357 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-46a66b9e-0cf7-498a-8b27-619b5261cdb2 req-f5708abb-8427-437c-8cc5-e7ef80dd2e75 admin admin] 10.222.0.61 "DELETE /compute/v2.1/os-assisted-volume-snapshots/d8a605d5-49c6-4033-aa07-b472d8e5a47b?delete_info=%7B%22file_to_merge%22:%20%22volume-225c0f05-9dab-4697-83d6-af277df3a3f8.d8a605d5-49c6-4033-aa07-b472d8e5a47b.vhdx%22,%20%22volume_id%22:%20%22225c0f05-9dab-4697-83d6-af277df3a3f8%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.157445 May 10 03:26:43.526357 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 474/968] 10.222.0.61 () {62 vars in 1800 bytes} [Tue May 10 03:26:43 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/d8a605d5-49c6-4033-aa07-b472d8e5a47b?delete_info=%7B%22file_to_merge%22:%20%22volume-225c0f05-9dab-4697-83d6-af277df3a3f8.d8a605d5-49c6-4033-aa07-b472d8e5a47b.vhdx%22,%20%22volume_id%22:%20%22225c0f05-9dab-4697-83d6-af277df3a3f8%22%7D => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 03:26:46.342478 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-db4a35a4-d8fe-4e07-b287-d8ccb35239fd tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:46.343085 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-db4a35a4-d8fe-4e07-b287-d8ccb35239fd tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:46.349351 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-db4a35a4-d8fe-4e07-b287-d8ccb35239fd tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:46.349842 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-db4a35a4-d8fe-4e07-b287-d8ccb35239fd tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:46.351252 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-db4a35a4-d8fe-4e07-b287-d8ccb35239fd tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:46.351686 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-db4a35a4-d8fe-4e07-b287-d8ccb35239fd tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:46.602848 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.objects.instance [None req-db4a35a4-d8fe-4e07-b287-d8ccb35239fd tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lazy-loading 'services' on Instance uuid 9280d0c1-8c42-414b-821f-12c9314bc50b {{(pid=117399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:26:46.871549 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-db4a35a4-d8fe-4e07-b287-d8ccb35239fd tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b/os-volume_attachments/225c0f05-9dab-4697-83d6-af277df3a3f8" status: 202 len: 0 microversion: 2.1 time: 0.533120 May 10 03:26:46.872161 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 495/969] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 10 03:26:46 2022] DELETE /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b/os-volume_attachments/225c0f05-9dab-4697-83d6-af277df3a3f8 => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:26:47.993934 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-fa2b271b-08a8-45fb-bde4-ae17b29b91dc tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:47.994553 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-fa2b271b-08a8-45fb-bde4-ae17b29b91dc tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:48.002692 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fa2b271b-08a8-45fb-bde4-ae17b29b91dc tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:48.003151 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fa2b271b-08a8-45fb-bde4-ae17b29b91dc tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:48.003949 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fa2b271b-08a8-45fb-bde4-ae17b29b91dc tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:48.004438 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-fa2b271b-08a8-45fb-bde4-ae17b29b91dc tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:48.030082 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-fa2b271b-08a8-45fb-bde4-ae17b29b91dc tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Going to try to terminate instance {{(pid=117400) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:26:48.297076 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-fa2b271b-08a8-45fb-bde4-ae17b29b91dc tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b" status: 204 len: 0 microversion: 2.1 time: 0.307422 May 10 03:26:48.297716 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 475/970] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:26:47 2022] DELETE /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:26:48.307174 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-913113ca-74e2-4c43-9c88-393d1848a698 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:48.307863 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-913113ca-74e2-4c43-9c88-393d1848a698 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:48.314339 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-913113ca-74e2-4c43-9c88-393d1848a698 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:48.314873 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-913113ca-74e2-4c43-9c88-393d1848a698 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:48.315689 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-913113ca-74e2-4c43-9c88-393d1848a698 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:48.316160 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-913113ca-74e2-4c43-9c88-393d1848a698 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:48.449655 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-913113ca-74e2-4c43-9c88-393d1848a698 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:48.457318 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-913113ca-74e2-4c43-9c88-393d1848a698 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b" status: 200 len: 1514 microversion: 2.1 time: 0.154762 May 10 03:26:48.462022 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 496/971] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:26:48 2022] GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:26:49.475388 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-09e4c0a1-db8b-418b-9dc2-cb16151c8f2a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:49.476043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-09e4c0a1-db8b-418b-9dc2-cb16151c8f2a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:49.482442 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-09e4c0a1-db8b-418b-9dc2-cb16151c8f2a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:49.482897 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-09e4c0a1-db8b-418b-9dc2-cb16151c8f2a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:49.483672 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-09e4c0a1-db8b-418b-9dc2-cb16151c8f2a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:49.484145 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-09e4c0a1-db8b-418b-9dc2-cb16151c8f2a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:49.615821 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-09e4c0a1-db8b-418b-9dc2-cb16151c8f2a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:49.623712 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-09e4c0a1-db8b-418b-9dc2-cb16151c8f2a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b" status: 200 len: 1514 microversion: 2.1 time: 0.152640 May 10 03:26:49.624311 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 476/972] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:26:49 2022] GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:26:50.641620 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-1a403737-2b97-4e7a-bcc2-31c124755e02 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:50.648481 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-1a403737-2b97-4e7a-bcc2-31c124755e02 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:50.649201 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1a403737-2b97-4e7a-bcc2-31c124755e02 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:50.649649 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1a403737-2b97-4e7a-bcc2-31c124755e02 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:50.650501 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1a403737-2b97-4e7a-bcc2-31c124755e02 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:50.650940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-1a403737-2b97-4e7a-bcc2-31c124755e02 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:50.787061 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-1a403737-2b97-4e7a-bcc2-31c124755e02 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:50.797662 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-1a403737-2b97-4e7a-bcc2-31c124755e02 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b" status: 200 len: 1514 microversion: 2.1 time: 0.159920 May 10 03:26:50.798230 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 497/973] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:26:50 2022] GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:51.814814 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-dd5be04b-7afe-4ba2-ad5f-6cd4f8fbc42d tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:51.815432 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-dd5be04b-7afe-4ba2-ad5f-6cd4f8fbc42d tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:51.823135 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-dd5be04b-7afe-4ba2-ad5f-6cd4f8fbc42d tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:51.823573 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-dd5be04b-7afe-4ba2-ad5f-6cd4f8fbc42d tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:51.824423 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-dd5be04b-7afe-4ba2-ad5f-6cd4f8fbc42d tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:51.824893 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-dd5be04b-7afe-4ba2-ad5f-6cd4f8fbc42d tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:52.025213 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-dd5be04b-7afe-4ba2-ad5f-6cd4f8fbc42d tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:52.033793 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-dd5be04b-7afe-4ba2-ad5f-6cd4f8fbc42d tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b" status: 200 len: 1514 microversion: 2.1 time: 0.222763 May 10 03:26:52.034379 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 477/974] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:26:51 2022] GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b => generated 1514 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:53.054658 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-09daa4b9-925c-40ab-ba99-2b54267042b8 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:53.055364 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-09daa4b9-925c-40ab-ba99-2b54267042b8 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:53.061991 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-09daa4b9-925c-40ab-ba99-2b54267042b8 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:53.062444 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-09daa4b9-925c-40ab-ba99-2b54267042b8 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:53.063207 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-09daa4b9-925c-40ab-ba99-2b54267042b8 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:53.063648 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-09daa4b9-925c-40ab-ba99-2b54267042b8 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:53.199183 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-09daa4b9-925c-40ab-ba99-2b54267042b8 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:53.206884 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-09daa4b9-925c-40ab-ba99-2b54267042b8 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b" status: 200 len: 1514 microversion: 2.1 time: 0.156071 May 10 03:26:53.207456 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 498/975] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:26:53 2022] GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:53.575048 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-356706c6-3af9-4ef5-be59-d3ab049630c7 req-2d4ae7c4-e40f-4a73-9d83-64381fe30f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9280d0c1-8c42-414b-821f-12c9314bc50b", "name": "network-vif-deleted", "tag": "72610399-4a51-40b7-b2b9-173be370b569"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:26:53.583343 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-356706c6-3af9-4ef5-be59-d3ab049630c7 req-2d4ae7c4-e40f-4a73-9d83-64381fe30f2a service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:53.583785 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-356706c6-3af9-4ef5-be59-d3ab049630c7 req-2d4ae7c4-e40f-4a73-9d83-64381fe30f2a service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:53.595159 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-356706c6-3af9-4ef5-be59-d3ab049630c7 req-2d4ae7c4-e40f-4a73-9d83-64381fe30f2a service nova] Creating event network-vif-deleted:72610399-4a51-40b7-b2b9-173be370b569 for instance 9280d0c1-8c42-414b-821f-12c9314bc50b on hv-cinder-83009 May 10 03:26:53.606340 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-356706c6-3af9-4ef5-be59-d3ab049630c7 req-2d4ae7c4-e40f-4a73-9d83-64381fe30f2a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034771 May 10 03:26:53.606976 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 478/976] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:26:54.227293 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-54f062e3-0079-4884-8116-416ea214ef71 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:54.227910 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-54f062e3-0079-4884-8116-416ea214ef71 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:54.234503 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-54f062e3-0079-4884-8116-416ea214ef71 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:54.234959 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-54f062e3-0079-4884-8116-416ea214ef71 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:54.235769 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-54f062e3-0079-4884-8116-416ea214ef71 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:54.236250 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-54f062e3-0079-4884-8116-416ea214ef71 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:54.268484 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-54f062e3-0079-4884-8116-416ea214ef71 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:54.269021 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-54f062e3-0079-4884-8116-416ea214ef71 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:54.269483 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.objects.instance [None req-54f062e3-0079-4884-8116-416ea214ef71 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lazy-loading 'fault' on Instance uuid 9280d0c1-8c42-414b-821f-12c9314bc50b {{(pid=117399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:26:54.320524 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-54f062e3-0079-4884-8116-416ea214ef71 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:54.328636 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-54f062e3-0079-4884-8116-416ea214ef71 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b" status: 200 len: 1309 microversion: 2.1 time: 0.105307 May 10 03:26:54.331924 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 499/977] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:26:54 2022] GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:54.355953 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-b6398114-8d1c-4ca1-be32-a7a298c75c5d tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-296524534", "imageRef": "7ce6e103-a571-4b59-9162-ff1107650c97", "flavorRef": "452", "networks": [{"uuid": "42685f3a-24aa-46f9-bc57-de0569bf3776"}]}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:26:54.405951 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.network.neutron [None req-b6398114-8d1c-4ca1-be32-a7a298c75c5d tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] validate_networks() for [('42685f3a-24aa-46f9-bc57-de0569bf3776', None, None, None, None, None)] {{(pid=117400) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:26:55.019342 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-b6398114-8d1c-4ca1-be32-a7a298c75c5d tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Flavor limits 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:26:55.019908 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-b6398114-8d1c-4ca1-be32-a7a298c75c5d tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Image limits 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:26:55.020287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-b6398114-8d1c-4ca1-be32-a7a298c75c5d tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Flavor pref 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:26:55.020701 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-b6398114-8d1c-4ca1-be32-a7a298c75c5d tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Image pref 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:26:55.021121 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-b6398114-8d1c-4ca1-be32-a7a298c75c5d tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:26:55.030379 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b6398114-8d1c-4ca1-be32-a7a298c75c5d tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:55.030768 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b6398114-8d1c-4ca1-be32-a7a298c75c5d tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:55.031579 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b6398114-8d1c-4ca1-be32-a7a298c75c5d tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:55.032039 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b6398114-8d1c-4ca1-be32-a7a298c75c5d tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:55.049174 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-b6398114-8d1c-4ca1-be32-a7a298c75c5d tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Getting quotas for project 999c5e799e2148c8b9385edb3f634e1d. Resources: {'cores', 'instances', 'ram'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:26:55.053898 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-b6398114-8d1c-4ca1-be32-a7a298c75c5d tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Getting quotas for user 919ba2451a4c4a1d82428794abd1214e and project 999c5e799e2148c8b9385edb3f634e1d. Resources: {'cores', 'instances', 'ram'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:26:55.065558 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-b6398114-8d1c-4ca1-be32-a7a298c75c5d tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Going to run 1 instances... {{(pid=117400) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:26:55.067931 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-b6398114-8d1c-4ca1-be32-a7a298c75c5d tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a9e9b8f7-3086-4218-be97-688142943655] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ce6e103-a571-4b59-9162-ff1107650c97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:26:55.216495 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-b6398114-8d1c-4ca1-be32-a7a298c75c5d tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.865377 May 10 03:26:55.217146 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 479/978] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 03:26:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 03:26:55.227851 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-eb8e9dab-db0e-4d25-81ed-7bf4a925aa0c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:55.229158 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-eb8e9dab-db0e-4d25-81ed-7bf4a925aa0c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a9e9b8f7-3086-4218-be97-688142943655] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:55.282884 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-eb8e9dab-db0e-4d25-81ed-7bf4a925aa0c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:55.289991 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-eb8e9dab-db0e-4d25-81ed-7bf4a925aa0c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655" status: 200 len: 1213 microversion: 2.1 time: 0.066163 May 10 03:26:55.290559 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 500/979] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:26:55 2022] GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655 => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:26:55.346684 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-8313dbcb-445a-48f8-b059-802b6eb64448 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:55.347309 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-8313dbcb-445a-48f8-b059-802b6eb64448 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 9280d0c1-8c42-414b-821f-12c9314bc50b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:55.354409 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8313dbcb-445a-48f8-b059-802b6eb64448 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:55.355244 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8313dbcb-445a-48f8-b059-802b6eb64448 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:55.355932 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8313dbcb-445a-48f8-b059-802b6eb64448 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:55.356421 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8313dbcb-445a-48f8-b059-802b6eb64448 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:55.370404 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-8313dbcb-445a-48f8-b059-802b6eb64448 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] HTTP exception thrown: Instance 9280d0c1-8c42-414b-821f-12c9314bc50b could not be found. May 10 03:26:55.372084 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-8313dbcb-445a-48f8-b059-802b6eb64448 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Request method failure captured: May 10 03:26:55.372084 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b HTTP/1.1 May 10 03:26:55.372084 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:26:55.372084 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:26:55.372084 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:26:55.372084 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:26:55.372084 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:26:55.372084 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:26:55.372084 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:26:55.372084 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:26:55.372084 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABieds9ol3X8CaKqqw5bNezJOsQvEgovlNQQN4dDPIPG-G-8uXU6JKCWfjZl7v1pyPAxn0n2pKjYtyjMGtSLknFIWizJ66ZnxF63MQxAvaXG3HVyGzdNO6uh16URjPReiGFwsV7-1N4Xqa-Uogm0GrKj6819Z4d0--QCS6hja2IsowL6WI May 10 03:26:55.372084 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:26:55.372084 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:26:55.372084 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:26:55.372084 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:26:55.372084 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:26:55.372084 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:26:55.372084 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: f3186bec57c94e2f84ae52cae506dbc2 May 10 03:26:55.372084 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1430955927 May 10 03:26:55.372084 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:26:55.372084 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:26:55.373771 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f3186bec57c94e2f84ae52cae506dbc2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f3186bec57c94e2f84ae52cae506dbc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f3186bec57c94e2f84ae52cae506dbc2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f3186bec57c94e2f84ae52cae506dbc2"}]}] May 10 03:26:55.373771 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-VolumesSnapshotTestJSON-1430955927 May 10 03:26:55.373771 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: f3186bec57c94e2f84ae52cae506dbc2 May 10 03:26:55.373771 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1430955927 May 10 03:26:55.373771 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-VolumesSnapshotTestJSON-1430955927-project May 10 03:26:55.373771 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:26:55.373771 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:26:55.373771 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: f43ec3800caa42ed9a4fcf3405ef3d5e May 10 03:26:55.373771 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-VolumesSnapshotTestJSON-1430955927-project May 10 03:26:55.373771 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:26:55.373771 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Instance 9280d0c1-8c42-414b-821f-12c9314bc50b could not be found. May 10 03:26:55.373771 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'id': '9280d0c1-8c42-414b-821f-12c9314bc50b'} May 10 03:26:55.374851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:26:55.374851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:55.374851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:26:55.374851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:26:55.374851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:26:55.374851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:26:55.374851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:26:55.374851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:26:55.374851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:26:55.374851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:26:55.374851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9280d0c1-8c42-414b-821f-12c9314bc50b could not be found. May 10 03:26:55.374851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:55.374851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:26:55.374851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:55.374851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:55.374851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:26:55.374851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:26:55.374851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:26:55.374851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:26:55.374851 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:26:55.376362 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:26:55.376362 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:26:55.376362 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:26:55.376362 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:26:55.376362 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:26:55.376362 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:26:55.376362 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:26:55.376362 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9280d0c1-8c42-414b-821f-12c9314bc50b could not be found. May 10 03:26:55.376362 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:55.376362 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:26:55.376362 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:55.376362 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:26:55.376362 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:26:55.376362 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:26:55.376362 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:26:55.376362 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:26:55.376362 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9280d0c1-8c42-414b-821f-12c9314bc50b could not be found. May 10 03:26:55.376362 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:26:55.377716 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-8313dbcb-445a-48f8-b059-802b6eb64448 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Returning 404 to user: Instance 9280d0c1-8c42-414b-821f-12c9314bc50b could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:26:55.377716 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-8313dbcb-445a-48f8-b059-802b6eb64448 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b" status: 404 len: 111 microversion: 2.1 time: 0.030751 May 10 03:26:55.377716 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 480/980] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:26:55 2022] GET /compute/v2.1/servers/9280d0c1-8c42-414b-821f-12c9314bc50b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:26:56.308619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-9eaddc9a-15e8-4d11-8fb3-81c90765959d tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:56.309251 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-9eaddc9a-15e8-4d11-8fb3-81c90765959d tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a9e9b8f7-3086-4218-be97-688142943655] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:56.363447 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-9eaddc9a-15e8-4d11-8fb3-81c90765959d tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:56.371205 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-9eaddc9a-15e8-4d11-8fb3-81c90765959d tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655" status: 200 len: 1213 microversion: 2.1 time: 0.068025 May 10 03:26:56.371808 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 501/981] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:26:56 2022] GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:57.388384 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-526213a7-a6b4-4ec7-8006-cb44b9fbe870 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:57.394298 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-526213a7-a6b4-4ec7-8006-cb44b9fbe870 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a9e9b8f7-3086-4218-be97-688142943655] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:57.395875 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-526213a7-a6b4-4ec7-8006-cb44b9fbe870 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:57.396363 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-526213a7-a6b4-4ec7-8006-cb44b9fbe870 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:57.397302 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-526213a7-a6b4-4ec7-8006-cb44b9fbe870 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:57.397736 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-526213a7-a6b4-4ec7-8006-cb44b9fbe870 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:57.473747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-526213a7-a6b4-4ec7-8006-cb44b9fbe870 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:57.481673 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-526213a7-a6b4-4ec7-8006-cb44b9fbe870 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655" status: 200 len: 1273 microversion: 2.1 time: 0.097263 May 10 03:26:57.482769 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 481/982] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:26:57 2022] GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655 => generated 1273 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:58.499292 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a1f9b12d-30cb-41d8-80cf-40015927e60c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:58.499937 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-a1f9b12d-30cb-41d8-80cf-40015927e60c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a9e9b8f7-3086-4218-be97-688142943655] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:58.506308 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a1f9b12d-30cb-41d8-80cf-40015927e60c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:58.506763 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a1f9b12d-30cb-41d8-80cf-40015927e60c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:58.507542 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a1f9b12d-30cb-41d8-80cf-40015927e60c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:58.508010 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a1f9b12d-30cb-41d8-80cf-40015927e60c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:58.660083 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-a1f9b12d-30cb-41d8-80cf-40015927e60c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:58.668057 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-a1f9b12d-30cb-41d8-80cf-40015927e60c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655" status: 200 len: 1313 microversion: 2.1 time: 0.172700 May 10 03:26:58.668652 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 502/983] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:26:58 2022] GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:26:59.096771 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-39d7339a-a4f7-4f7c-8afa-95c77a2e558a req-de8196d6-01c9-49a1-bd92-cbcc12737a44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9e9b8f7-3086-4218-be97-688142943655", "tag": "1287e67c-1a88-438a-b5b8-4fd8c0bbbdad"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:26:59.105992 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-39d7339a-a4f7-4f7c-8afa-95c77a2e558a req-de8196d6-01c9-49a1-bd92-cbcc12737a44 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:59.114488 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-39d7339a-a4f7-4f7c-8afa-95c77a2e558a req-de8196d6-01c9-49a1-bd92-cbcc12737a44 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:59.117291 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-39d7339a-a4f7-4f7c-8afa-95c77a2e558a req-de8196d6-01c9-49a1-bd92-cbcc12737a44 service nova] Creating event network-changed:1287e67c-1a88-438a-b5b8-4fd8c0bbbdad for instance a9e9b8f7-3086-4218-be97-688142943655 on hv-cinder-83009 May 10 03:26:59.121854 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-39d7339a-a4f7-4f7c-8afa-95c77a2e558a req-de8196d6-01c9-49a1-bd92-cbcc12737a44 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030055 May 10 03:26:59.122476 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 482/984] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:26:59.694617 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-226eea82-559b-42c6-b92e-f8709a62946b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:26:59.695249 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-226eea82-559b-42c6-b92e-f8709a62946b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a9e9b8f7-3086-4218-be97-688142943655] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:26:59.703163 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-226eea82-559b-42c6-b92e-f8709a62946b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:59.703656 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-226eea82-559b-42c6-b92e-f8709a62946b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:59.704471 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-226eea82-559b-42c6-b92e-f8709a62946b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:26:59.704912 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-226eea82-559b-42c6-b92e-f8709a62946b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:26:59.746541 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-6ab56eef-17a7-4340-9c03-dd4949792d62 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2120204199", "imageRef": "7ce6e103-a571-4b59-9162-ff1107650c97", "flavorRef": "452", "networks": [{"uuid": "3b28b3fa-2732-4380-8d7f-37cccd7876c1"}]}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:26:59.798392 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.network.neutron [None req-6ab56eef-17a7-4340-9c03-dd4949792d62 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] validate_networks() for [('3b28b3fa-2732-4380-8d7f-37cccd7876c1', None, None, None, None, None)] {{(pid=117400) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:26:59.912327 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-226eea82-559b-42c6-b92e-f8709a62946b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:26:59.920248 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-226eea82-559b-42c6-b92e-f8709a62946b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655" status: 200 len: 1313 microversion: 2.1 time: 0.229456 May 10 03:26:59.921024 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 503/985] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:26:59 2022] GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:00.162248 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-6ab56eef-17a7-4340-9c03-dd4949792d62 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Flavor limits 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:27:00.162723 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-6ab56eef-17a7-4340-9c03-dd4949792d62 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Image limits 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:27:00.163143 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-6ab56eef-17a7-4340-9c03-dd4949792d62 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Flavor pref 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:27:00.163583 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-6ab56eef-17a7-4340-9c03-dd4949792d62 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Image pref 0:0:0 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:27:00.163999 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.virt.hardware [None req-6ab56eef-17a7-4340-9c03-dd4949792d62 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:27:00.173280 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6ab56eef-17a7-4340-9c03-dd4949792d62 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:00.173731 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6ab56eef-17a7-4340-9c03-dd4949792d62 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:00.174791 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6ab56eef-17a7-4340-9c03-dd4949792d62 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:00.175238 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6ab56eef-17a7-4340-9c03-dd4949792d62 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:00.191262 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-6ab56eef-17a7-4340-9c03-dd4949792d62 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Getting quotas for project f3186bec57c94e2f84ae52cae506dbc2. Resources: {'cores', 'instances', 'ram'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:27:00.195238 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.quota [None req-6ab56eef-17a7-4340-9c03-dd4949792d62 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Getting quotas for user f43ec3800caa42ed9a4fcf3405ef3d5e and project f3186bec57c94e2f84ae52cae506dbc2. Resources: {'cores', 'instances', 'ram'} {{(pid=117400) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:27:00.205919 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-6ab56eef-17a7-4340-9c03-dd4949792d62 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Going to run 1 instances... {{(pid=117400) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:27:00.208249 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-6ab56eef-17a7-4340-9c03-dd4949792d62 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ce6e103-a571-4b59-9162-ff1107650c97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:27:00.326142 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-6ab56eef-17a7-4340-9c03-dd4949792d62 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584381 May 10 03:27:00.326996 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 483/986] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 03:26:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 03:27:00.336612 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-615daa02-b506-4df0-b443-31d3b4e5931c tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:00.337727 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-615daa02-b506-4df0-b443-31d3b4e5931c tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:00.397571 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-615daa02-b506-4df0-b443-31d3b4e5931c tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:00.404735 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-615daa02-b506-4df0-b443-31d3b4e5931c tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2" status: 200 len: 1219 microversion: 2.1 time: 0.071866 May 10 03:27:00.405307 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 504/987] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:00 2022] GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:27:00.937647 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-c279629d-f14d-4566-8a95-f39125065373 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:00.938200 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-c279629d-f14d-4566-8a95-f39125065373 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a9e9b8f7-3086-4218-be97-688142943655] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:00.947558 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c279629d-f14d-4566-8a95-f39125065373 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:00.948022 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c279629d-f14d-4566-8a95-f39125065373 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:00.948805 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c279629d-f14d-4566-8a95-f39125065373 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:00.949287 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-c279629d-f14d-4566-8a95-f39125065373 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:01.075338 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-c279629d-f14d-4566-8a95-f39125065373 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:01.082769 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-c279629d-f14d-4566-8a95-f39125065373 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655" status: 200 len: 1313 microversion: 2.1 time: 0.149075 May 10 03:27:01.083338 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 484/988] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:00 2022] GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:01.422049 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c8fe7b5d-7b57-4615-953b-049fd68792c7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:01.422658 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-c8fe7b5d-7b57-4615-953b-049fd68792c7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:01.429866 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c8fe7b5d-7b57-4615-953b-049fd68792c7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:01.430315 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c8fe7b5d-7b57-4615-953b-049fd68792c7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:01.431126 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c8fe7b5d-7b57-4615-953b-049fd68792c7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:01.431569 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c8fe7b5d-7b57-4615-953b-049fd68792c7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:01.495545 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-c8fe7b5d-7b57-4615-953b-049fd68792c7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:01.502940 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-c8fe7b5d-7b57-4615-953b-049fd68792c7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2" status: 200 len: 1215 microversion: 2.1 time: 0.085023 May 10 03:27:01.503500 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 505/989] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:01 2022] GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2 => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:02.098710 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-05822a47-48f8-48d1-8232-bf5eea107945 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:02.099322 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-05822a47-48f8-48d1-8232-bf5eea107945 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a9e9b8f7-3086-4218-be97-688142943655] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:02.106195 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-05822a47-48f8-48d1-8232-bf5eea107945 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:02.106650 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-05822a47-48f8-48d1-8232-bf5eea107945 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:02.107473 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-05822a47-48f8-48d1-8232-bf5eea107945 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:02.107912 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-05822a47-48f8-48d1-8232-bf5eea107945 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:02.239546 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-05822a47-48f8-48d1-8232-bf5eea107945 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:02.249669 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-05822a47-48f8-48d1-8232-bf5eea107945 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655" status: 200 len: 1313 microversion: 2.1 time: 0.154606 May 10 03:27:02.250543 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 485/990] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:02 2022] GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:02.522443 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-bb780514-f753-4595-8db0-efa5ea97fc53 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:02.528163 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-bb780514-f753-4595-8db0-efa5ea97fc53 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:02.530065 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bb780514-f753-4595-8db0-efa5ea97fc53 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:02.530706 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bb780514-f753-4595-8db0-efa5ea97fc53 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:02.531642 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bb780514-f753-4595-8db0-efa5ea97fc53 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:02.532266 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-bb780514-f753-4595-8db0-efa5ea97fc53 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:02.598288 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-bb780514-f753-4595-8db0-efa5ea97fc53 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:02.605570 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-bb780514-f753-4595-8db0-efa5ea97fc53 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2" status: 200 len: 1277 microversion: 2.1 time: 0.086903 May 10 03:27:02.606145 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 506/991] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:02 2022] GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2 => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:03.269230 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-37bd8fa7-0977-4791-b5e6-cc8e98e64754 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:03.269776 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-37bd8fa7-0977-4791-b5e6-cc8e98e64754 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a9e9b8f7-3086-4218-be97-688142943655] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:03.276175 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-37bd8fa7-0977-4791-b5e6-cc8e98e64754 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:03.276700 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-37bd8fa7-0977-4791-b5e6-cc8e98e64754 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:03.277481 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-37bd8fa7-0977-4791-b5e6-cc8e98e64754 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:03.277952 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-37bd8fa7-0977-4791-b5e6-cc8e98e64754 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:03.417798 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-900f1535-4df8-419c-b46b-fb3c86c1ea1c req-93e56a66-5fc2-46b7-ac73-8a68d1040e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e9b8f7-3086-4218-be97-688142943655", "name": "network-vif-plugged", "status": "completed", "tag": "1287e67c-1a88-438a-b5b8-4fd8c0bbbdad"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:27:03.428853 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-900f1535-4df8-419c-b46b-fb3c86c1ea1c req-93e56a66-5fc2-46b7-ac73-8a68d1040e11 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:03.429220 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-900f1535-4df8-419c-b46b-fb3c86c1ea1c req-93e56a66-5fc2-46b7-ac73-8a68d1040e11 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:03.432689 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-37bd8fa7-0977-4791-b5e6-cc8e98e64754 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:03.440289 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-37bd8fa7-0977-4791-b5e6-cc8e98e64754 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655" status: 200 len: 1313 microversion: 2.1 time: 0.175247 May 10 03:27:03.441928 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 486/992] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:03 2022] GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:03.442199 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-900f1535-4df8-419c-b46b-fb3c86c1ea1c req-93e56a66-5fc2-46b7-ac73-8a68d1040e11 service nova] Creating event network-vif-plugged:1287e67c-1a88-438a-b5b8-4fd8c0bbbdad for instance a9e9b8f7-3086-4218-be97-688142943655 on hv-cinder-83009 May 10 03:27:03.453427 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-900f1535-4df8-419c-b46b-fb3c86c1ea1c req-93e56a66-5fc2-46b7-ac73-8a68d1040e11 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039176 May 10 03:27:03.459501 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 507/993] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:27:03.623418 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-8e9152cc-e2f2-42a8-a106-4501fb59641e tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:03.624076 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-8e9152cc-e2f2-42a8-a106-4501fb59641e tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:03.629946 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8e9152cc-e2f2-42a8-a106-4501fb59641e tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:03.630403 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8e9152cc-e2f2-42a8-a106-4501fb59641e tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:03.631189 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8e9152cc-e2f2-42a8-a106-4501fb59641e tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:03.631627 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-8e9152cc-e2f2-42a8-a106-4501fb59641e tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:03.762741 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-8e9152cc-e2f2-42a8-a106-4501fb59641e tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:03.770088 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-8e9152cc-e2f2-42a8-a106-4501fb59641e tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2" status: 200 len: 1319 microversion: 2.1 time: 0.150677 May 10 03:27:03.770667 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 487/994] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:03 2022] GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:04.109239 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-c582d7cc-2ec3-474f-b8d9-ecb856f09abd req-0f2ba74c-9b39-4902-a740-2a472502c6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d7937f8-db90-44e2-9495-9ccffbe717d2", "tag": "e2732a60-6e91-4621-a5bb-e288ab297bfa"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:27:04.119408 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-c582d7cc-2ec3-474f-b8d9-ecb856f09abd req-0f2ba74c-9b39-4902-a740-2a472502c6f5 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:04.120178 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-c582d7cc-2ec3-474f-b8d9-ecb856f09abd req-0f2ba74c-9b39-4902-a740-2a472502c6f5 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:04.134921 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-c582d7cc-2ec3-474f-b8d9-ecb856f09abd req-0f2ba74c-9b39-4902-a740-2a472502c6f5 service nova] Creating event network-changed:e2732a60-6e91-4621-a5bb-e288ab297bfa for instance 7d7937f8-db90-44e2-9495-9ccffbe717d2 on hv-cinder-83009 May 10 03:27:04.137555 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-c582d7cc-2ec3-474f-b8d9-ecb856f09abd req-0f2ba74c-9b39-4902-a740-2a472502c6f5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032604 May 10 03:27:04.138148 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 508/995] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:27:04.457983 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-3494e810-ded9-4893-a841-7f3bd4980665 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:04.458543 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-3494e810-ded9-4893-a841-7f3bd4980665 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a9e9b8f7-3086-4218-be97-688142943655] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:04.465480 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3494e810-ded9-4893-a841-7f3bd4980665 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:04.465884 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3494e810-ded9-4893-a841-7f3bd4980665 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:04.466655 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3494e810-ded9-4893-a841-7f3bd4980665 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:04.467087 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3494e810-ded9-4893-a841-7f3bd4980665 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:04.596310 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-3494e810-ded9-4893-a841-7f3bd4980665 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:04.604133 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-3494e810-ded9-4893-a841-7f3bd4980665 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655" status: 200 len: 1313 microversion: 2.1 time: 0.150050 May 10 03:27:04.604708 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 488/996] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:04 2022] GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:04.787207 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-2a3d4d48-a1bc-494b-a4a9-46aec3577a7a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:04.788426 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-2a3d4d48-a1bc-494b-a4a9-46aec3577a7a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:04.795169 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2a3d4d48-a1bc-494b-a4a9-46aec3577a7a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:04.795631 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2a3d4d48-a1bc-494b-a4a9-46aec3577a7a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:04.796444 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2a3d4d48-a1bc-494b-a4a9-46aec3577a7a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:04.796889 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2a3d4d48-a1bc-494b-a4a9-46aec3577a7a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:04.933015 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-2a3d4d48-a1bc-494b-a4a9-46aec3577a7a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:04.940465 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-2a3d4d48-a1bc-494b-a4a9-46aec3577a7a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2" status: 200 len: 1319 microversion: 2.1 time: 0.157466 May 10 03:27:04.941223 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 509/997] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:04 2022] GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:27:05.620082 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-caafce10-2cec-456c-9658-a887ca5e8dac tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:05.620846 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-caafce10-2cec-456c-9658-a887ca5e8dac tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a9e9b8f7-3086-4218-be97-688142943655] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:05.627183 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-caafce10-2cec-456c-9658-a887ca5e8dac tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:05.627661 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-caafce10-2cec-456c-9658-a887ca5e8dac tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:05.628503 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-caafce10-2cec-456c-9658-a887ca5e8dac tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:05.628935 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-caafce10-2cec-456c-9658-a887ca5e8dac tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:05.765140 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-caafce10-2cec-456c-9658-a887ca5e8dac tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:05.772643 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-caafce10-2cec-456c-9658-a887ca5e8dac tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655" status: 200 len: 1313 microversion: 2.1 time: 0.156511 May 10 03:27:05.773207 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 489/998] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:05 2022] GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:05.956981 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e0617d08-eeb8-4be3-8944-f87e4d7f61cb tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:05.957597 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-e0617d08-eeb8-4be3-8944-f87e4d7f61cb tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:05.964573 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e0617d08-eeb8-4be3-8944-f87e4d7f61cb tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:05.964977 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e0617d08-eeb8-4be3-8944-f87e4d7f61cb tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:05.965748 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e0617d08-eeb8-4be3-8944-f87e4d7f61cb tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:05.966191 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e0617d08-eeb8-4be3-8944-f87e4d7f61cb tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:06.096497 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-e0617d08-eeb8-4be3-8944-f87e4d7f61cb tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:06.104352 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-e0617d08-eeb8-4be3-8944-f87e4d7f61cb tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2" status: 200 len: 1319 microversion: 2.1 time: 0.150682 May 10 03:27:06.104911 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 510/999] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:05 2022] GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:06.788780 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-ed035bdd-8876-486c-ae40-3a96c38dbef2 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:06.789421 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-ed035bdd-8876-486c-ae40-3a96c38dbef2 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a9e9b8f7-3086-4218-be97-688142943655] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:06.795815 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ed035bdd-8876-486c-ae40-3a96c38dbef2 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:06.797997 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ed035bdd-8876-486c-ae40-3a96c38dbef2 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:06.797997 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ed035bdd-8876-486c-ae40-3a96c38dbef2 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:06.797997 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ed035bdd-8876-486c-ae40-3a96c38dbef2 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:06.932388 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ed035bdd-8876-486c-ae40-3a96c38dbef2 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:06.940293 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-ed035bdd-8876-486c-ae40-3a96c38dbef2 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655" status: 200 len: 1496 microversion: 2.1 time: 0.155377 May 10 03:27:06.941188 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 490/1000] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:06 2022] GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655 => generated 1496 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:07.121302 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-94c06783-9a9d-4c8d-9d8d-67e9f98efa9f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:07.122035 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-94c06783-9a9d-4c8d-9d8d-67e9f98efa9f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:07.128630 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-94c06783-9a9d-4c8d-9d8d-67e9f98efa9f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:07.129080 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-94c06783-9a9d-4c8d-9d8d-67e9f98efa9f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:07.129917 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-94c06783-9a9d-4c8d-9d8d-67e9f98efa9f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:07.130355 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-94c06783-9a9d-4c8d-9d8d-67e9f98efa9f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:07.270411 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-94c06783-9a9d-4c8d-9d8d-67e9f98efa9f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:07.278266 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-94c06783-9a9d-4c8d-9d8d-67e9f98efa9f tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2" status: 200 len: 1319 microversion: 2.1 time: 0.161331 May 10 03:27:07.278851 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 511/1001] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:07 2022] GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:07.917445 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-350df3e2-8ce6-45a3-baab-01d24f9f2efb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:07.917942 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-350df3e2-8ce6-45a3-baab-01d24f9f2efb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a9e9b8f7-3086-4218-be97-688142943655] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:07.924141 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-350df3e2-8ce6-45a3-baab-01d24f9f2efb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:07.924592 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-350df3e2-8ce6-45a3-baab-01d24f9f2efb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:07.925623 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-350df3e2-8ce6-45a3-baab-01d24f9f2efb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:07.926062 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-350df3e2-8ce6-45a3-baab-01d24f9f2efb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:07.950773 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-350df3e2-8ce6-45a3-baab-01d24f9f2efb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a9e9b8f7-3086-4218-be97-688142943655] Going to try to terminate instance {{(pid=117400) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:27:08.210698 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-350df3e2-8ce6-45a3-baab-01d24f9f2efb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655" status: 204 len: 0 microversion: 2.1 time: 0.297325 May 10 03:27:08.211221 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 491/1002] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:27:07 2022] DELETE /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:27:08.220356 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-b854c3b4-ca1c-4f50-94c2-69d2855fa0d7 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:08.220971 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-b854c3b4-ca1c-4f50-94c2-69d2855fa0d7 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a9e9b8f7-3086-4218-be97-688142943655] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:08.227505 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b854c3b4-ca1c-4f50-94c2-69d2855fa0d7 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:08.229037 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b854c3b4-ca1c-4f50-94c2-69d2855fa0d7 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:08.229290 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b854c3b4-ca1c-4f50-94c2-69d2855fa0d7 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:08.229733 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-b854c3b4-ca1c-4f50-94c2-69d2855fa0d7 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:08.295162 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-612b399f-14d0-44c0-85ff-b44bd9c5588d tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:08.295867 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-612b399f-14d0-44c0-85ff-b44bd9c5588d tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:08.302144 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-612b399f-14d0-44c0-85ff-b44bd9c5588d tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:08.302600 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-612b399f-14d0-44c0-85ff-b44bd9c5588d tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:08.303443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-612b399f-14d0-44c0-85ff-b44bd9c5588d tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:08.303890 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-612b399f-14d0-44c0-85ff-b44bd9c5588d tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:08.385634 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-b854c3b4-ca1c-4f50-94c2-69d2855fa0d7 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:08.393735 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-b854c3b4-ca1c-4f50-94c2-69d2855fa0d7 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655" status: 200 len: 1502 microversion: 2.1 time: 0.176759 May 10 03:27:08.394338 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 512/1003] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:08 2022] GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655 => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:08.444345 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-612b399f-14d0-44c0-85ff-b44bd9c5588d tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:08.452667 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-612b399f-14d0-44c0-85ff-b44bd9c5588d tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2" status: 200 len: 1319 microversion: 2.1 time: 0.161642 May 10 03:27:08.453369 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 492/1004] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:08 2022] GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:27:09.411380 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-6409a25c-6d6f-46b7-bbd1-d250a40a399b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:09.412037 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-6409a25c-6d6f-46b7-bbd1-d250a40a399b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a9e9b8f7-3086-4218-be97-688142943655] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:09.420080 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6409a25c-6d6f-46b7-bbd1-d250a40a399b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:09.420412 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6409a25c-6d6f-46b7-bbd1-d250a40a399b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:09.421183 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6409a25c-6d6f-46b7-bbd1-d250a40a399b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:09.421619 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-6409a25c-6d6f-46b7-bbd1-d250a40a399b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:09.427433 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-6ff29f54-7ad1-4d5b-b650-fd14894cb219 req-9d512b3c-1d5a-411d-8f56-b1f6fb518dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7937f8-db90-44e2-9495-9ccffbe717d2", "name": "network-vif-plugged", "status": "completed", "tag": "e2732a60-6e91-4621-a5bb-e288ab297bfa"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:27:09.435805 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-6ff29f54-7ad1-4d5b-b650-fd14894cb219 req-9d512b3c-1d5a-411d-8f56-b1f6fb518dc0 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:09.436281 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-6ff29f54-7ad1-4d5b-b650-fd14894cb219 req-9d512b3c-1d5a-411d-8f56-b1f6fb518dc0 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:09.447171 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-6ff29f54-7ad1-4d5b-b650-fd14894cb219 req-9d512b3c-1d5a-411d-8f56-b1f6fb518dc0 service nova] Creating event network-vif-plugged:e2732a60-6e91-4621-a5bb-e288ab297bfa for instance 7d7937f8-db90-44e2-9495-9ccffbe717d2 on hv-cinder-83009 May 10 03:27:09.451998 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-6ff29f54-7ad1-4d5b-b650-fd14894cb219 req-9d512b3c-1d5a-411d-8f56-b1f6fb518dc0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028553 May 10 03:27:09.452622 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 493/1005] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:27:09.470139 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-0aed6fab-f000-46cd-a67c-acd77a70265e tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:09.471632 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-0aed6fab-f000-46cd-a67c-acd77a70265e tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:09.481997 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0aed6fab-f000-46cd-a67c-acd77a70265e tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:09.482595 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0aed6fab-f000-46cd-a67c-acd77a70265e tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:09.483404 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0aed6fab-f000-46cd-a67c-acd77a70265e tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:09.483967 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-0aed6fab-f000-46cd-a67c-acd77a70265e tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:09.625800 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-6409a25c-6d6f-46b7-bbd1-d250a40a399b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:09.634684 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-6409a25c-6d6f-46b7-bbd1-d250a40a399b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655" status: 200 len: 1502 microversion: 2.1 time: 0.227224 May 10 03:27:09.635441 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 513/1006] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:09 2022] GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655 => generated 1502 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:09.663026 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-0aed6fab-f000-46cd-a67c-acd77a70265e tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:09.671836 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-0aed6fab-f000-46cd-a67c-acd77a70265e tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2" status: 200 len: 1319 microversion: 2.1 time: 0.205819 May 10 03:27:09.672457 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 494/1007] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:09 2022] GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:27:10.101618 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-626a00ab-9e01-4d25-9607-1ebac1f5b22f req-32e0dc25-518c-43b2-9bc3-9b3f7249bed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e9b8f7-3086-4218-be97-688142943655", "name": "network-vif-deleted", "tag": "1287e67c-1a88-438a-b5b8-4fd8c0bbbdad"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:27:10.109438 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-626a00ab-9e01-4d25-9607-1ebac1f5b22f req-32e0dc25-518c-43b2-9bc3-9b3f7249bed0 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:10.109891 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-626a00ab-9e01-4d25-9607-1ebac1f5b22f req-32e0dc25-518c-43b2-9bc3-9b3f7249bed0 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:10.120971 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-626a00ab-9e01-4d25-9607-1ebac1f5b22f req-32e0dc25-518c-43b2-9bc3-9b3f7249bed0 service nova] Creating event network-vif-deleted:1287e67c-1a88-438a-b5b8-4fd8c0bbbdad for instance a9e9b8f7-3086-4218-be97-688142943655 on hv-cinder-83009 May 10 03:27:10.125764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-626a00ab-9e01-4d25-9607-1ebac1f5b22f req-32e0dc25-518c-43b2-9bc3-9b3f7249bed0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027836 May 10 03:27:10.126520 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 514/1008] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:27:10.652854 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-bf9e12d8-5715-438e-adba-919f70a2f56c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:10.653405 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-bf9e12d8-5715-438e-adba-919f70a2f56c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a9e9b8f7-3086-4218-be97-688142943655] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:10.660025 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bf9e12d8-5715-438e-adba-919f70a2f56c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:10.660502 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bf9e12d8-5715-438e-adba-919f70a2f56c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:10.661273 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bf9e12d8-5715-438e-adba-919f70a2f56c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:10.661718 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bf9e12d8-5715-438e-adba-919f70a2f56c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:10.692813 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bf9e12d8-5715-438e-adba-919f70a2f56c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:10.693267 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bf9e12d8-5715-438e-adba-919f70a2f56c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:10.693828 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.objects.instance [None req-bf9e12d8-5715-438e-adba-919f70a2f56c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lazy-loading 'fault' on Instance uuid a9e9b8f7-3086-4218-be97-688142943655 {{(pid=117400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:27:10.694135 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-2d7fc80d-b8dd-4d0d-862b-f8a3191d6615 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:10.694845 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-2d7fc80d-b8dd-4d0d-862b-f8a3191d6615 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:10.701717 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2d7fc80d-b8dd-4d0d-862b-f8a3191d6615 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:10.703650 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2d7fc80d-b8dd-4d0d-862b-f8a3191d6615 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:10.703650 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2d7fc80d-b8dd-4d0d-862b-f8a3191d6615 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:10.703650 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-2d7fc80d-b8dd-4d0d-862b-f8a3191d6615 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:10.735198 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-bf9e12d8-5715-438e-adba-919f70a2f56c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:10.742722 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-bf9e12d8-5715-438e-adba-919f70a2f56c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655" status: 200 len: 1303 microversion: 2.1 time: 0.094346 May 10 03:27:10.743306 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 495/1009] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:10 2022] GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:10.834029 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-2d7fc80d-b8dd-4d0d-862b-f8a3191d6615 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:10.842089 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-2d7fc80d-b8dd-4d0d-862b-f8a3191d6615 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2" status: 200 len: 1319 microversion: 2.1 time: 0.151982 May 10 03:27:10.842743 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 515/1010] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:10 2022] GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:27:11.759657 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-3d2b39ed-5654-4492-ae11-6d4f4a02eae5 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:11.760326 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-3d2b39ed-5654-4492-ae11-6d4f4a02eae5 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a9e9b8f7-3086-4218-be97-688142943655] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:11.766727 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3d2b39ed-5654-4492-ae11-6d4f4a02eae5 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:11.767185 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3d2b39ed-5654-4492-ae11-6d4f4a02eae5 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:11.767952 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3d2b39ed-5654-4492-ae11-6d4f4a02eae5 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:11.768419 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3d2b39ed-5654-4492-ae11-6d4f4a02eae5 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:11.802208 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3d2b39ed-5654-4492-ae11-6d4f4a02eae5 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:11.802647 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-3d2b39ed-5654-4492-ae11-6d4f4a02eae5 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:11.803089 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.objects.instance [None req-3d2b39ed-5654-4492-ae11-6d4f4a02eae5 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lazy-loading 'fault' on Instance uuid a9e9b8f7-3086-4218-be97-688142943655 {{(pid=117400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:27:11.842576 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-3d2b39ed-5654-4492-ae11-6d4f4a02eae5 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:11.849645 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-3d2b39ed-5654-4492-ae11-6d4f4a02eae5 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655" status: 200 len: 1303 microversion: 2.1 time: 0.093871 May 10 03:27:11.850216 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 496/1011] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:11 2022] GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:11.859124 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-c58675dc-ee57-4ff9-a735-07bd7e6f7a76 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:11.859740 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-c58675dc-ee57-4ff9-a735-07bd7e6f7a76 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:11.866256 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c58675dc-ee57-4ff9-a735-07bd7e6f7a76 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:11.866701 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c58675dc-ee57-4ff9-a735-07bd7e6f7a76 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:11.867502 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c58675dc-ee57-4ff9-a735-07bd7e6f7a76 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:11.867913 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-c58675dc-ee57-4ff9-a735-07bd7e6f7a76 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:11.997013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-c58675dc-ee57-4ff9-a735-07bd7e6f7a76 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:12.010125 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-c58675dc-ee57-4ff9-a735-07bd7e6f7a76 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2" status: 200 len: 1509 microversion: 2.1 time: 0.154150 May 10 03:27:12.013243 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 516/1012] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:11 2022] GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:12.026698 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a819a799-3f84-41cb-8c97-b9365fd3355c tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f5f65b6-4de4-40b2-a170-ed4c23927ffd", "device": "/dev/sdb"}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:27:12.027878 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-a819a799-3f84-41cb-8c97-b9365fd3355c tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:12.033916 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a819a799-3f84-41cb-8c97-b9365fd3355c tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:12.034372 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a819a799-3f84-41cb-8c97-b9365fd3355c tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:12.035180 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a819a799-3f84-41cb-8c97-b9365fd3355c tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:12.035627 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a819a799-3f84-41cb-8c97-b9365fd3355c tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:12.866892 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a7bf5bc2-24da-4bbc-abde-865cd48b4b1b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:12.867505 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-a7bf5bc2-24da-4bbc-abde-865cd48b4b1b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a9e9b8f7-3086-4218-be97-688142943655] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:12.873868 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a7bf5bc2-24da-4bbc-abde-865cd48b4b1b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:12.874319 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a7bf5bc2-24da-4bbc-abde-865cd48b4b1b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:12.875087 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a7bf5bc2-24da-4bbc-abde-865cd48b4b1b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:12.875529 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-a7bf5bc2-24da-4bbc-abde-865cd48b4b1b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:12.891102 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.wsgi [None req-a7bf5bc2-24da-4bbc-abde-865cd48b4b1b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] HTTP exception thrown: Instance a9e9b8f7-3086-4218-be97-688142943655 could not be found. May 10 03:27:12.894685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a7bf5bc2-24da-4bbc-abde-865cd48b4b1b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Request method failure captured: May 10 03:27:12.894685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: request: GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655 HTTP/1.1 May 10 03:27:12.894685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept: application/json May 10 03:27:12.894685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Accept-Encoding: identity May 10 03:27:12.894685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Connection: close May 10 03:27:12.894685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Length: 0 May 10 03:27:12.894685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Content-Type: application/json May 10 03:27:12.894685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Host: 10.222.0.65 May 10 03:27:12.894685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Openstack-System-Scope: None May 10 03:27:12.894685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: User-Agent: python-urllib3/1.26.9 May 10 03:27:12.894685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Auth-Token: gAAAAABiedt8O5QuIyOcqF5w5WlvlRD5pyHx7kupo_fehlSywzOqgp2TxDvHbl4fv7f8-uZj6OYwOfX2GL7B0XKpey0ExhlAUNUlA6Ee_2nQfGCAQcKhrnFKHg00PPTd2_rRgvmPQM2jyA_O01cmLa6vLWQiauXJwVw2IPLCl7Lt_OG5T4Vs34I May 10 03:27:12.894685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Id: None May 10 03:27:12.894685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Domain-Name: None May 10 03:27:12.894685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Identity-Status: Confirmed May 10 03:27:12.894685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Is-Admin-Project: True May 10 03:27:12.894685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Id: default May 10 03:27:12.894685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Domain-Name: Default May 10 03:27:12.894685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Id: 999c5e799e2148c8b9385edb3f634e1d May 10 03:27:12.894685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Project-Name: tempest-VolumesActionsTest-887473746 May 10 03:27:12.894685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Role: reader,member May 10 03:27:12.894685 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Roles: reader,member May 10 03:27:12.896640 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_999c5e799e2148c8b9385edb3f634e1d", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/999c5e799e2148c8b9385edb3f634e1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/999c5e799e2148c8b9385edb3f634e1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/999c5e799e2148c8b9385edb3f634e1d"}]}] May 10 03:27:12.896640 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant: tempest-VolumesActionsTest-887473746 May 10 03:27:12.896640 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Id: 999c5e799e2148c8b9385edb3f634e1d May 10 03:27:12.896640 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-Tenant-Name: tempest-VolumesActionsTest-887473746 May 10 03:27:12.896640 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User: tempest-VolumesActionsTest-887473746-project May 10 03:27:12.896640 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Id: default May 10 03:27:12.896640 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Domain-Name: Default May 10 03:27:12.896640 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Id: 919ba2451a4c4a1d82428794abd1214e May 10 03:27:12.896640 dv-cinder-830094-4-smb devstack@n-api.service[117399]: X-User-Name: tempest-VolumesActionsTest-887473746-project May 10 03:27:12.896640 dv-cinder-830094-4-smb devstack@n-api.service[117399]: method: > May 10 03:27:12.896640 dv-cinder-830094-4-smb devstack@n-api.service[117399]: exception: Instance a9e9b8f7-3086-4218-be97-688142943655 could not be found. May 10 03:27:12.896640 dv-cinder-830094-4-smb devstack@n-api.service[117399]: action_args: {'id': 'a9e9b8f7-3086-4218-be97-688142943655'} May 10 03:27:12.897675 dv-cinder-830094-4-smb devstack@n-api.service[117399]: {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:27:12.897675 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:27:12.897675 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:27:12.897675 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:27:12.897675 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:27:12.897675 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:27:12.897675 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:27:12.897675 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:27:12.897675 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:27:12.897675 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:27:12.897675 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9e9b8f7-3086-4218-be97-688142943655 could not be found. May 10 03:27:12.897675 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:27:12.897675 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:27:12.897675 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:27:12.897675 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:27:12.897675 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:27:12.897675 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:27:12.897675 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:27:12.897675 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:27:12.897675 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:27:12.899229 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:27:12.899229 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:27:12.899229 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:27:12.899229 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:27:12.899229 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:27:12.899229 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:27:12.899229 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:27:12.899229 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9e9b8f7-3086-4218-be97-688142943655 could not be found. May 10 03:27:12.899229 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:27:12.899229 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:27:12.899229 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:27:12.899229 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:27:12.899229 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:27:12.899229 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:27:12.899229 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:27:12.899229 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:27:12.899229 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9e9b8f7-3086-4218-be97-688142943655 could not be found. May 10 03:27:12.899229 dv-cinder-830094-4-smb devstack@n-api.service[117399]: ERROR nova.api.openstack.wsgi May 10 03:27:12.900648 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-a7bf5bc2-24da-4bbc-abde-865cd48b4b1b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Returning 404 to user: Instance a9e9b8f7-3086-4218-be97-688142943655 could not be found. {{(pid=117399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:27:12.900648 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-a7bf5bc2-24da-4bbc-abde-865cd48b4b1b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655" status: 404 len: 111 microversion: 2.1 time: 0.031420 May 10 03:27:12.900648 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 517/1013] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:12 2022] GET /compute/v2.1/servers/a9e9b8f7-3086-4218-be97-688142943655 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 03:27:12.942832 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-8eac6172-7536-4b51-8e5c-fb99e6acfb15 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1547760260", "imageRef": "7ce6e103-a571-4b59-9162-ff1107650c97", "flavorRef": "452", "networks": [{"uuid": "42685f3a-24aa-46f9-bc57-de0569bf3776"}]}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:27:12.953443 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-a819a799-3f84-41cb-8c97-b9365fd3355c tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "POST /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.930378 May 10 03:27:12.957633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 497/1014] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 10 03:27:12 2022] POST /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2/os-volume_attachments => generated 194 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:27:13.000202 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.network.neutron [None req-8eac6172-7536-4b51-8e5c-fb99e6acfb15 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] validate_networks() for [('42685f3a-24aa-46f9-bc57-de0569bf3776', None, None, None, None, None)] {{(pid=117399) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 03:27:13.340864 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-8eac6172-7536-4b51-8e5c-fb99e6acfb15 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Flavor limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 03:27:13.341556 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-8eac6172-7536-4b51-8e5c-fb99e6acfb15 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Image limits 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 03:27:13.341902 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-8eac6172-7536-4b51-8e5c-fb99e6acfb15 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Flavor pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 03:27:13.342322 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-8eac6172-7536-4b51-8e5c-fb99e6acfb15 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Image pref 0:0:0 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 03:27:13.342730 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.virt.hardware [None req-8eac6172-7536-4b51-8e5c-fb99e6acfb15 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117399) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 03:27:13.351349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8eac6172-7536-4b51-8e5c-fb99e6acfb15 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:13.355748 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8eac6172-7536-4b51-8e5c-fb99e6acfb15 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:13.355748 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8eac6172-7536-4b51-8e5c-fb99e6acfb15 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:13.355748 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-8eac6172-7536-4b51-8e5c-fb99e6acfb15 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:13.372307 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-8eac6172-7536-4b51-8e5c-fb99e6acfb15 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Getting quotas for project 999c5e799e2148c8b9385edb3f634e1d. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 03:27:13.376628 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.quota [None req-8eac6172-7536-4b51-8e5c-fb99e6acfb15 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Getting quotas for user 919ba2451a4c4a1d82428794abd1214e and project 999c5e799e2148c8b9385edb3f634e1d. Resources: {'cores', 'instances', 'ram'} {{(pid=117399) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 03:27:13.387588 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8eac6172-7536-4b51-8e5c-fb99e6acfb15 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Going to run 1 instances... {{(pid=117399) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 03:27:13.392031 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-8eac6172-7536-4b51-8e5c-fb99e6acfb15 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a546e10c-c501-4bd4-bcf4-701f007ffa8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ce6e103-a571-4b59-9162-ff1107650c97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117399) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 03:27:13.507858 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-8eac6172-7536-4b51-8e5c-fb99e6acfb15 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568844 May 10 03:27:13.508522 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 518/1015] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 10 03:27:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 03:27:13.519362 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-ff862bad-8abd-42d8-a710-77f0a17d62bc tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:13.520068 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-ff862bad-8abd-42d8-a710-77f0a17d62bc tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a546e10c-c501-4bd4-bcf4-701f007ffa8b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:13.577420 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ff862bad-8abd-42d8-a710-77f0a17d62bc tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:13.584312 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-ff862bad-8abd-42d8-a710-77f0a17d62bc tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b" status: 200 len: 1214 microversion: 2.1 time: 0.069479 May 10 03:27:13.584891 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 498/1016] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:13 2022] GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:27:14.602005 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-0752510c-2dd2-47c2-a78c-99fc7795d0d3 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:14.602605 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-0752510c-2dd2-47c2-a78c-99fc7795d0d3 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a546e10c-c501-4bd4-bcf4-701f007ffa8b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:14.608548 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0752510c-2dd2-47c2-a78c-99fc7795d0d3 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:14.611588 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0752510c-2dd2-47c2-a78c-99fc7795d0d3 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:14.611588 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0752510c-2dd2-47c2-a78c-99fc7795d0d3 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:14.611588 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0752510c-2dd2-47c2-a78c-99fc7795d0d3 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:14.673548 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-0752510c-2dd2-47c2-a78c-99fc7795d0d3 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:14.686205 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-0752510c-2dd2-47c2-a78c-99fc7795d0d3 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b" status: 200 len: 1218 microversion: 2.1 time: 0.088469 May 10 03:27:14.687451 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 519/1017] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:14 2022] GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:15.704195 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-ddbe8bb3-bbfd-40ab-8b45-7345c36a7bbb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:15.704804 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-ddbe8bb3-bbfd-40ab-8b45-7345c36a7bbb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a546e10c-c501-4bd4-bcf4-701f007ffa8b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:15.711976 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ddbe8bb3-bbfd-40ab-8b45-7345c36a7bbb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:15.712517 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ddbe8bb3-bbfd-40ab-8b45-7345c36a7bbb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:15.713276 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ddbe8bb3-bbfd-40ab-8b45-7345c36a7bbb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:15.713704 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-ddbe8bb3-bbfd-40ab-8b45-7345c36a7bbb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:15.773068 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-ddbe8bb3-bbfd-40ab-8b45-7345c36a7bbb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:15.780991 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-ddbe8bb3-bbfd-40ab-8b45-7345c36a7bbb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b" status: 200 len: 1266 microversion: 2.1 time: 0.080659 May 10 03:27:15.781575 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 499/1018] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:15 2022] GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:16.118959 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-cdde9a84-661a-4d69-b4f3-b206f24d4909 req-50770faf-6c5a-492a-88d7-8c318e6431a6 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "1f5f65b6-4de4-40b2-a170-ed4c23927ffd", "create_info": {"type": "qcow2", "new_file": "volume-1f5f65b6-4de4-40b2-a170-ed4c23927ffd.e131be1f-1905-4606-a002-befac1d6bf23.vhdx", "snapshot_id": "e131be1f-1905-4606-a002-befac1d6bf23"}}} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:27:16.121758 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-cdde9a84-661a-4d69-b4f3-b206f24d4909 req-50770faf-6c5a-492a-88d7-8c318e6431a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:16.122349 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-cdde9a84-661a-4d69-b4f3-b206f24d4909 req-50770faf-6c5a-492a-88d7-8c318e6431a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:16.130598 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-cdde9a84-661a-4d69-b4f3-b206f24d4909 req-50770faf-6c5a-492a-88d7-8c318e6431a6 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:16.131138 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-cdde9a84-661a-4d69-b4f3-b206f24d4909 req-50770faf-6c5a-492a-88d7-8c318e6431a6 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:16.146403 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-cdde9a84-661a-4d69-b4f3-b206f24d4909 req-50770faf-6c5a-492a-88d7-8c318e6431a6 admin admin] 10.222.0.61 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.144470 May 10 03:27:16.146991 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 520/1019] 10.222.0.61 () {64 vars in 1326 bytes} [Tue May 10 03:27:16 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 03:27:16.799082 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-6a1c2ced-626d-4584-8d3f-971a1dbe8c2c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:16.799793 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-6a1c2ced-626d-4584-8d3f-971a1dbe8c2c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a546e10c-c501-4bd4-bcf4-701f007ffa8b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:16.806719 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6a1c2ced-626d-4584-8d3f-971a1dbe8c2c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:16.807202 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6a1c2ced-626d-4584-8d3f-971a1dbe8c2c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:16.807975 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6a1c2ced-626d-4584-8d3f-971a1dbe8c2c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:16.808589 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6a1c2ced-626d-4584-8d3f-971a1dbe8c2c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:16.940027 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-6a1c2ced-626d-4584-8d3f-971a1dbe8c2c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:16.947567 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-6a1c2ced-626d-4584-8d3f-971a1dbe8c2c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b" status: 200 len: 1314 microversion: 2.1 time: 0.152228 May 10 03:27:16.948253 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 500/1020] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:16 2022] GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:17.533307 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-dd4a73a4-5afc-4f20-bea9-17bec151caad req-db0046b5-b2fb-42b5-8595-e28de273583a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a546e10c-c501-4bd4-bcf4-701f007ffa8b", "tag": "f0b02d37-6688-4909-bd2c-c159f754f640"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:27:17.541447 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-dd4a73a4-5afc-4f20-bea9-17bec151caad req-db0046b5-b2fb-42b5-8595-e28de273583a service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:17.541885 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-dd4a73a4-5afc-4f20-bea9-17bec151caad req-db0046b5-b2fb-42b5-8595-e28de273583a service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:17.553090 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-dd4a73a4-5afc-4f20-bea9-17bec151caad req-db0046b5-b2fb-42b5-8595-e28de273583a service nova] Creating event network-changed:f0b02d37-6688-4909-bd2c-c159f754f640 for instance a546e10c-c501-4bd4-bcf4-701f007ffa8b on hv-cinder-83009 May 10 03:27:17.557094 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-dd4a73a4-5afc-4f20-bea9-17bec151caad req-db0046b5-b2fb-42b5-8595-e28de273583a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029163 May 10 03:27:17.557634 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 521/1021] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:27:17.964963 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-d845ff2c-a28b-4df5-b244-b5da917f0e00 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:17.965563 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-d845ff2c-a28b-4df5-b244-b5da917f0e00 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a546e10c-c501-4bd4-bcf4-701f007ffa8b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:17.971744 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d845ff2c-a28b-4df5-b244-b5da917f0e00 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:17.972234 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d845ff2c-a28b-4df5-b244-b5da917f0e00 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:17.972993 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d845ff2c-a28b-4df5-b244-b5da917f0e00 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:17.973426 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-d845ff2c-a28b-4df5-b244-b5da917f0e00 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:18.100305 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-d845ff2c-a28b-4df5-b244-b5da917f0e00 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:18.108142 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-d845ff2c-a28b-4df5-b244-b5da917f0e00 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b" status: 200 len: 1314 microversion: 2.1 time: 0.146959 May 10 03:27:18.108803 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 501/1022] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:17 2022] GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:19.126062 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-26529b59-4d46-48d0-8372-937d91b1cc3f tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:19.126760 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-26529b59-4d46-48d0-8372-937d91b1cc3f tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a546e10c-c501-4bd4-bcf4-701f007ffa8b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:19.133520 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-26529b59-4d46-48d0-8372-937d91b1cc3f tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:19.133520 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-26529b59-4d46-48d0-8372-937d91b1cc3f tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:19.134034 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-26529b59-4d46-48d0-8372-937d91b1cc3f tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:19.134480 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-26529b59-4d46-48d0-8372-937d91b1cc3f tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:19.263880 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-26529b59-4d46-48d0-8372-937d91b1cc3f tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:19.271555 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-26529b59-4d46-48d0-8372-937d91b1cc3f tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b" status: 200 len: 1314 microversion: 2.1 time: 0.150097 May 10 03:27:19.272170 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 522/1023] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:19 2022] GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:27:19.345634 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-a5a799f2-490b-42ab-8828-43033d24d7ab req-b393fe85-3486-4cac-99a6-dd0388661522 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "1f5f65b6-4de4-40b2-a170-ed4c23927ffd", "create_info": {"type": "qcow2", "new_file": "volume-1f5f65b6-4de4-40b2-a170-ed4c23927ffd.3a0bb45c-62ee-4e10-8305-95b4c2e689c4.vhdx", "snapshot_id": "3a0bb45c-62ee-4e10-8305-95b4c2e689c4"}}} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:27:19.347672 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-a5a799f2-490b-42ab-8828-43033d24d7ab req-b393fe85-3486-4cac-99a6-dd0388661522 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:19.348141 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-a5a799f2-490b-42ab-8828-43033d24d7ab req-b393fe85-3486-4cac-99a6-dd0388661522 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:19.356593 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-a5a799f2-490b-42ab-8828-43033d24d7ab req-b393fe85-3486-4cac-99a6-dd0388661522 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:19.357032 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-a5a799f2-490b-42ab-8828-43033d24d7ab req-b393fe85-3486-4cac-99a6-dd0388661522 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:19.370137 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-a5a799f2-490b-42ab-8828-43033d24d7ab req-b393fe85-3486-4cac-99a6-dd0388661522 admin admin] 10.222.0.61 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.078797 May 10 03:27:19.371700 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 502/1024] 10.222.0.61 () {64 vars in 1326 bytes} [Tue May 10 03:27:19 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 03:27:20.288916 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ccf8a380-4cca-49ce-afc1-a639e03037bb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:20.289479 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ccf8a380-4cca-49ce-afc1-a639e03037bb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a546e10c-c501-4bd4-bcf4-701f007ffa8b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:20.295717 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ccf8a380-4cca-49ce-afc1-a639e03037bb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:20.296208 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ccf8a380-4cca-49ce-afc1-a639e03037bb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:20.296969 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ccf8a380-4cca-49ce-afc1-a639e03037bb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:20.297407 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ccf8a380-4cca-49ce-afc1-a639e03037bb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:20.442290 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ccf8a380-4cca-49ce-afc1-a639e03037bb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:20.449688 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ccf8a380-4cca-49ce-afc1-a639e03037bb tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b" status: 200 len: 1314 microversion: 2.1 time: 0.164759 May 10 03:27:20.451102 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 523/1025] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:20 2022] GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:21.467963 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-75c98202-9e8c-4fe8-bc58-118e3b6f1970 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:21.468574 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-75c98202-9e8c-4fe8-bc58-118e3b6f1970 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a546e10c-c501-4bd4-bcf4-701f007ffa8b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:21.475110 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-75c98202-9e8c-4fe8-bc58-118e3b6f1970 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:21.475558 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-75c98202-9e8c-4fe8-bc58-118e3b6f1970 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:21.476419 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-75c98202-9e8c-4fe8-bc58-118e3b6f1970 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:21.482050 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-75c98202-9e8c-4fe8-bc58-118e3b6f1970 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:21.610165 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-75c98202-9e8c-4fe8-bc58-118e3b6f1970 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:21.617537 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-75c98202-9e8c-4fe8-bc58-118e3b6f1970 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b" status: 200 len: 1314 microversion: 2.1 time: 0.154577 May 10 03:27:21.618101 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 503/1026] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:21 2022] GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:22.268188 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-6a541432-cd5a-4000-a3fe-0bfde8777f63 req-4513f261-5bff-493c-89e2-e7d16b05203b admin admin] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:22.270214 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-6a541432-cd5a-4000-a3fe-0bfde8777f63 req-4513f261-5bff-493c-89e2-e7d16b05203b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:22.270654 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-6a541432-cd5a-4000-a3fe-0bfde8777f63 req-4513f261-5bff-493c-89e2-e7d16b05203b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:22.279269 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-6a541432-cd5a-4000-a3fe-0bfde8777f63 req-4513f261-5bff-493c-89e2-e7d16b05203b admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:22.279712 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-6a541432-cd5a-4000-a3fe-0bfde8777f63 req-4513f261-5bff-493c-89e2-e7d16b05203b admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:22.292654 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-6a541432-cd5a-4000-a3fe-0bfde8777f63 req-4513f261-5bff-493c-89e2-e7d16b05203b admin admin] 10.222.0.61 "DELETE /compute/v2.1/os-assisted-volume-snapshots/3a0bb45c-62ee-4e10-8305-95b4c2e689c4?delete_info=%7B%22file_to_merge%22:%20%22volume-1f5f65b6-4de4-40b2-a170-ed4c23927ffd.3a0bb45c-62ee-4e10-8305-95b4c2e689c4.vhdx%22,%20%22volume_id%22:%20%221f5f65b6-4de4-40b2-a170-ed4c23927ffd%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.072039 May 10 03:27:22.293221 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 524/1027] 10.222.0.61 () {62 vars in 1800 bytes} [Tue May 10 03:27:22 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/3a0bb45c-62ee-4e10-8305-95b4c2e689c4?delete_info=%7B%22file_to_merge%22:%20%22volume-1f5f65b6-4de4-40b2-a170-ed4c23927ffd.3a0bb45c-62ee-4e10-8305-95b4c2e689c4.vhdx%22,%20%22volume_id%22:%20%221f5f65b6-4de4-40b2-a170-ed4c23927ffd%22%7D => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:27:22.634192 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-58370c55-3c0d-4b4a-82a7-ea912a2e066a tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:22.634808 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-58370c55-3c0d-4b4a-82a7-ea912a2e066a tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a546e10c-c501-4bd4-bcf4-701f007ffa8b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:22.641818 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-58370c55-3c0d-4b4a-82a7-ea912a2e066a tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:22.642272 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-58370c55-3c0d-4b4a-82a7-ea912a2e066a tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:22.643047 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-58370c55-3c0d-4b4a-82a7-ea912a2e066a tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:22.643489 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-58370c55-3c0d-4b4a-82a7-ea912a2e066a tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:22.776839 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-58370c55-3c0d-4b4a-82a7-ea912a2e066a tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:22.784023 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-58370c55-3c0d-4b4a-82a7-ea912a2e066a tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b" status: 200 len: 1314 microversion: 2.1 time: 0.153684 May 10 03:27:22.784637 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 504/1028] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:22 2022] GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:23.595200 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-c53c3697-7d73-4d4c-b77b-5c70d41ce007 req-fd45604e-bae0-4079-bace-50915cceefe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a546e10c-c501-4bd4-bcf4-701f007ffa8b", "name": "network-vif-plugged", "status": "completed", "tag": "f0b02d37-6688-4909-bd2c-c159f754f640"}]} {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:27:23.603216 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-c53c3697-7d73-4d4c-b77b-5c70d41ce007 req-fd45604e-bae0-4079-bace-50915cceefe6 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:23.608102 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-c53c3697-7d73-4d4c-b77b-5c70d41ce007 req-fd45604e-bae0-4079-bace-50915cceefe6 service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:23.614362 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.compute.server_external_events [req-c53c3697-7d73-4d4c-b77b-5c70d41ce007 req-fd45604e-bae0-4079-bace-50915cceefe6 service nova] Creating event network-vif-plugged:f0b02d37-6688-4909-bd2c-c159f754f640 for instance a546e10c-c501-4bd4-bcf4-701f007ffa8b on hv-cinder-83009 May 10 03:27:23.619021 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-c53c3697-7d73-4d4c-b77b-5c70d41ce007 req-fd45604e-bae0-4079-bace-50915cceefe6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028441 May 10 03:27:23.619654 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 525/1029] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:27:23.800847 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-6d03a6c4-ec3e-4656-9092-0226e76eefad tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:23.801461 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-6d03a6c4-ec3e-4656-9092-0226e76eefad tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a546e10c-c501-4bd4-bcf4-701f007ffa8b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:23.809203 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6d03a6c4-ec3e-4656-9092-0226e76eefad tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:23.817569 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6d03a6c4-ec3e-4656-9092-0226e76eefad tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:23.817569 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6d03a6c4-ec3e-4656-9092-0226e76eefad tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:23.817569 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-6d03a6c4-ec3e-4656-9092-0226e76eefad tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:23.938243 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-6d03a6c4-ec3e-4656-9092-0226e76eefad tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:23.945481 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-6d03a6c4-ec3e-4656-9092-0226e76eefad tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b" status: 200 len: 1314 microversion: 2.1 time: 0.148814 May 10 03:27:23.946043 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 505/1030] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:23 2022] GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:24.963208 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-400acae4-678a-4b17-b029-d6fd3037f29b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:24.963912 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-400acae4-678a-4b17-b029-d6fd3037f29b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a546e10c-c501-4bd4-bcf4-701f007ffa8b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:24.970209 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-400acae4-678a-4b17-b029-d6fd3037f29b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:24.970664 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-400acae4-678a-4b17-b029-d6fd3037f29b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:24.971436 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-400acae4-678a-4b17-b029-d6fd3037f29b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:24.971877 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-400acae4-678a-4b17-b029-d6fd3037f29b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:25.113113 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-400acae4-678a-4b17-b029-d6fd3037f29b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:25.120420 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-400acae4-678a-4b17-b029-d6fd3037f29b tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b" status: 200 len: 1314 microversion: 2.1 time: 0.161904 May 10 03:27:25.121494 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 526/1031] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:24 2022] GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:25.474525 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-43f41868-e028-4128-96d5-c4457fc05996 req-a889a5da-635c-46e5-830a-931c2a3def47 admin admin] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:25.474525 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-43f41868-e028-4128-96d5-c4457fc05996 req-a889a5da-635c-46e5-830a-931c2a3def47 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:25.474525 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-43f41868-e028-4128-96d5-c4457fc05996 req-a889a5da-635c-46e5-830a-931c2a3def47 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:25.481452 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-43f41868-e028-4128-96d5-c4457fc05996 req-a889a5da-635c-46e5-830a-931c2a3def47 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:25.481925 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-43f41868-e028-4128-96d5-c4457fc05996 req-a889a5da-635c-46e5-830a-931c2a3def47 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:25.497060 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-43f41868-e028-4128-96d5-c4457fc05996 req-a889a5da-635c-46e5-830a-931c2a3def47 admin admin] 10.222.0.61 "DELETE /compute/v2.1/os-assisted-volume-snapshots/fa3fff3d-f7ab-4ddc-85c8-be42d2538931?delete_info=%7B%22file_to_merge%22:%20%22volume-1f5f65b6-4de4-40b2-a170-ed4c23927ffd.fa3fff3d-f7ab-4ddc-85c8-be42d2538931.vhdx%22,%20%22volume_id%22:%20%221f5f65b6-4de4-40b2-a170-ed4c23927ffd%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.075166 May 10 03:27:25.497827 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 506/1032] 10.222.0.61 () {62 vars in 1800 bytes} [Tue May 10 03:27:25 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/fa3fff3d-f7ab-4ddc-85c8-be42d2538931?delete_info=%7B%22file_to_merge%22:%20%22volume-1f5f65b6-4de4-40b2-a170-ed4c23927ffd.fa3fff3d-f7ab-4ddc-85c8-be42d2538931.vhdx%22,%20%22volume_id%22:%20%221f5f65b6-4de4-40b2-a170-ed4c23927ffd%22%7D => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:27:26.138240 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-f3d6c2d5-4565-4280-98c7-c4e591f19a4c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:26.138843 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-f3d6c2d5-4565-4280-98c7-c4e591f19a4c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a546e10c-c501-4bd4-bcf4-701f007ffa8b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:26.145124 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f3d6c2d5-4565-4280-98c7-c4e591f19a4c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:26.145568 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f3d6c2d5-4565-4280-98c7-c4e591f19a4c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:26.146325 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f3d6c2d5-4565-4280-98c7-c4e591f19a4c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:26.146756 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-f3d6c2d5-4565-4280-98c7-c4e591f19a4c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:26.272467 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-f3d6c2d5-4565-4280-98c7-c4e591f19a4c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:26.280259 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-f3d6c2d5-4565-4280-98c7-c4e591f19a4c tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b" status: 200 len: 1497 microversion: 2.1 time: 0.146409 May 10 03:27:26.280855 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 527/1033] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:26 2022] GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:27.088849 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-28d31787-6fe9-4bf2-ab02-7346fcedeec8 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:27.089990 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-28d31787-6fe9-4bf2-ab02-7346fcedeec8 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a546e10c-c501-4bd4-bcf4-701f007ffa8b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:27.096562 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-28d31787-6fe9-4bf2-ab02-7346fcedeec8 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:27.097008 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-28d31787-6fe9-4bf2-ab02-7346fcedeec8 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:27.097773 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-28d31787-6fe9-4bf2-ab02-7346fcedeec8 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:27.098239 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-28d31787-6fe9-4bf2-ab02-7346fcedeec8 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:27.123469 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-28d31787-6fe9-4bf2-ab02-7346fcedeec8 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a546e10c-c501-4bd4-bcf4-701f007ffa8b] Going to try to terminate instance {{(pid=117400) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:27:27.397254 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-28d31787-6fe9-4bf2-ab02-7346fcedeec8 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b" status: 204 len: 0 microversion: 2.1 time: 0.312301 May 10 03:27:27.397853 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 507/1034] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:27:27 2022] DELETE /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:27:27.406455 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-922d2f62-57cd-4176-b9aa-dc3115f080ec tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:27.407069 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-922d2f62-57cd-4176-b9aa-dc3115f080ec tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a546e10c-c501-4bd4-bcf4-701f007ffa8b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:27.414408 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-922d2f62-57cd-4176-b9aa-dc3115f080ec tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:27.414861 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-922d2f62-57cd-4176-b9aa-dc3115f080ec tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:27.415640 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-922d2f62-57cd-4176-b9aa-dc3115f080ec tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:27.416117 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-922d2f62-57cd-4176-b9aa-dc3115f080ec tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:27.553224 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-922d2f62-57cd-4176-b9aa-dc3115f080ec tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:27.561136 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-922d2f62-57cd-4176-b9aa-dc3115f080ec tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b" status: 200 len: 1503 microversion: 2.1 time: 0.158991 May 10 03:27:27.561708 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 528/1035] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:27 2022] GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:28.579863 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-36e68bd8-9dde-49a6-b282-0644dffb83e0 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:28.580689 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-36e68bd8-9dde-49a6-b282-0644dffb83e0 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a546e10c-c501-4bd4-bcf4-701f007ffa8b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:28.591461 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-36e68bd8-9dde-49a6-b282-0644dffb83e0 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:28.591919 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-36e68bd8-9dde-49a6-b282-0644dffb83e0 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:28.592722 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-36e68bd8-9dde-49a6-b282-0644dffb83e0 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:28.593161 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-36e68bd8-9dde-49a6-b282-0644dffb83e0 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:28.706054 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [req-1131f9b1-26e9-4e74-a4e3-5dbd4f54aebb req-26aa5049-70a4-4182-9fbc-ace1dce3b658 admin admin] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:28.708157 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-1131f9b1-26e9-4e74-a4e3-5dbd4f54aebb req-26aa5049-70a4-4182-9fbc-ace1dce3b658 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:28.708604 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-1131f9b1-26e9-4e74-a4e3-5dbd4f54aebb req-26aa5049-70a4-4182-9fbc-ace1dce3b658 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:28.717296 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-1131f9b1-26e9-4e74-a4e3-5dbd4f54aebb req-26aa5049-70a4-4182-9fbc-ace1dce3b658 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:28.724123 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [req-1131f9b1-26e9-4e74-a4e3-5dbd4f54aebb req-26aa5049-70a4-4182-9fbc-ace1dce3b658 admin admin] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:28.735262 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-36e68bd8-9dde-49a6-b282-0644dffb83e0 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:28.742628 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [req-1131f9b1-26e9-4e74-a4e3-5dbd4f54aebb req-26aa5049-70a4-4182-9fbc-ace1dce3b658 admin admin] 10.222.0.61 "DELETE /compute/v2.1/os-assisted-volume-snapshots/e131be1f-1905-4606-a002-befac1d6bf23?delete_info=%7B%22file_to_merge%22:%20%22volume-1f5f65b6-4de4-40b2-a170-ed4c23927ffd.e131be1f-1905-4606-a002-befac1d6bf23.vhdx%22,%20%22volume_id%22:%20%221f5f65b6-4de4-40b2-a170-ed4c23927ffd%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.089659 May 10 03:27:28.742819 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-36e68bd8-9dde-49a6-b282-0644dffb83e0 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b" status: 200 len: 1503 microversion: 2.1 time: 0.167348 May 10 03:27:28.743214 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 529/1036] 10.222.0.61 () {62 vars in 1800 bytes} [Tue May 10 03:27:28 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/e131be1f-1905-4606-a002-befac1d6bf23?delete_info=%7B%22file_to_merge%22:%20%22volume-1f5f65b6-4de4-40b2-a170-ed4c23927ffd.e131be1f-1905-4606-a002-befac1d6bf23.vhdx%22,%20%22volume_id%22:%20%221f5f65b6-4de4-40b2-a170-ed4c23927ffd%22%7D => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 03:27:28.743530 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 508/1037] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:28 2022] GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:29.762512 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-0e7841bc-4700-4213-850b-8edfc0139bfe tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:29.764716 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-0e7841bc-4700-4213-850b-8edfc0139bfe tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a546e10c-c501-4bd4-bcf4-701f007ffa8b] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:29.778156 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0e7841bc-4700-4213-850b-8edfc0139bfe tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:29.778605 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0e7841bc-4700-4213-850b-8edfc0139bfe tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:29.779417 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0e7841bc-4700-4213-850b-8edfc0139bfe tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:29.779980 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-0e7841bc-4700-4213-850b-8edfc0139bfe tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:29.819713 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-21077121-1574-4544-b389-624c3b9eb114 req-299fa224-f848-41d9-a2e5-2ef43f190bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a546e10c-c501-4bd4-bcf4-701f007ffa8b", "name": "network-vif-deleted", "tag": "f0b02d37-6688-4909-bd2c-c159f754f640"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:27:29.828878 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-21077121-1574-4544-b389-624c3b9eb114 req-299fa224-f848-41d9-a2e5-2ef43f190bbe service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:29.835038 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-21077121-1574-4544-b389-624c3b9eb114 req-299fa224-f848-41d9-a2e5-2ef43f190bbe service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:29.841517 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-21077121-1574-4544-b389-624c3b9eb114 req-299fa224-f848-41d9-a2e5-2ef43f190bbe service nova] Creating event network-vif-deleted:f0b02d37-6688-4909-bd2c-c159f754f640 for instance a546e10c-c501-4bd4-bcf4-701f007ffa8b on hv-cinder-83009 May 10 03:27:29.845240 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-0e7841bc-4700-4213-850b-8edfc0139bfe tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919ba2451a4c4a1d82428794abd1214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999c5e799e2148c8b9385edb3f634e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:29.846955 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-21077121-1574-4544-b389-624c3b9eb114 req-299fa224-f848-41d9-a2e5-2ef43f190bbe service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030863 May 10 03:27:29.847554 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 509/1038] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 03:27:29.852918 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-0e7841bc-4700-4213-850b-8edfc0139bfe tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b" status: 200 len: 1461 microversion: 2.1 time: 0.096472 May 10 03:27:29.853477 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 530/1039] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:29 2022] GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b => generated 1461 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:30.870125 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-bfb4bad7-6d62-4567-9dc1-1702f99557c5 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:30.870970 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-bfb4bad7-6d62-4567-9dc1-1702f99557c5 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] [instance: a546e10c-c501-4bd4-bcf4-701f007ffa8b] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:30.877468 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bfb4bad7-6d62-4567-9dc1-1702f99557c5 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:30.877910 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bfb4bad7-6d62-4567-9dc1-1702f99557c5 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:30.878666 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bfb4bad7-6d62-4567-9dc1-1702f99557c5 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:30.879096 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-bfb4bad7-6d62-4567-9dc1-1702f99557c5 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:30.891995 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-bfb4bad7-6d62-4567-9dc1-1702f99557c5 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] HTTP exception thrown: Instance a546e10c-c501-4bd4-bcf4-701f007ffa8b could not be found. May 10 03:27:30.893633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-bfb4bad7-6d62-4567-9dc1-1702f99557c5 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Request method failure captured: May 10 03:27:30.893633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b HTTP/1.1 May 10 03:27:30.893633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:27:30.893633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:27:30.893633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:27:30.893633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:27:30.893633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:27:30.893633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:27:30.893633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:27:30.893633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:27:30.893633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABiedt8O5QuIyOcqF5w5WlvlRD5pyHx7kupo_fehlSywzOqgp2TxDvHbl4fv7f8-uZj6OYwOfX2GL7B0XKpey0ExhlAUNUlA6Ee_2nQfGCAQcKhrnFKHg00PPTd2_rRgvmPQM2jyA_O01cmLa6vLWQiauXJwVw2IPLCl7Lt_OG5T4Vs34I May 10 03:27:30.893633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:27:30.893633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:27:30.893633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:27:30.893633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:27:30.893633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:27:30.893633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:27:30.893633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: 999c5e799e2148c8b9385edb3f634e1d May 10 03:27:30.893633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-VolumesActionsTest-887473746 May 10 03:27:30.893633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:27:30.893633 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:27:30.895253 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_999c5e799e2148c8b9385edb3f634e1d", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/999c5e799e2148c8b9385edb3f634e1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/999c5e799e2148c8b9385edb3f634e1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/999c5e799e2148c8b9385edb3f634e1d"}]}] May 10 03:27:30.895253 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-VolumesActionsTest-887473746 May 10 03:27:30.895253 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: 999c5e799e2148c8b9385edb3f634e1d May 10 03:27:30.895253 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-VolumesActionsTest-887473746 May 10 03:27:30.895253 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-VolumesActionsTest-887473746-project May 10 03:27:30.895253 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:27:30.895253 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:27:30.895253 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: 919ba2451a4c4a1d82428794abd1214e May 10 03:27:30.895253 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-VolumesActionsTest-887473746-project May 10 03:27:30.895253 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:27:30.895253 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Instance a546e10c-c501-4bd4-bcf4-701f007ffa8b could not be found. May 10 03:27:30.895253 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'id': 'a546e10c-c501-4bd4-bcf4-701f007ffa8b'} May 10 03:27:30.896406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:27:30.896406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:27:30.896406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:27:30.896406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:27:30.896406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:27:30.896406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:27:30.896406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:27:30.896406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:27:30.896406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:27:30.896406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:27:30.896406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a546e10c-c501-4bd4-bcf4-701f007ffa8b could not be found. May 10 03:27:30.896406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:27:30.896406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:27:30.896406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:27:30.896406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:27:30.896406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:27:30.896406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:27:30.896406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:27:30.896406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:27:30.896406 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:27:30.897914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:27:30.897914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:27:30.897914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:27:30.897914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:27:30.897914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:27:30.897914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:27:30.897914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:27:30.897914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a546e10c-c501-4bd4-bcf4-701f007ffa8b could not be found. May 10 03:27:30.897914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:27:30.897914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:27:30.897914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:27:30.897914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:27:30.897914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:27:30.897914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:27:30.897914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:27:30.897914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:27:30.897914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a546e10c-c501-4bd4-bcf4-701f007ffa8b could not be found. May 10 03:27:30.897914 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:27:30.899201 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-bfb4bad7-6d62-4567-9dc1-1702f99557c5 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] Returning 404 to user: Instance a546e10c-c501-4bd4-bcf4-701f007ffa8b could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:27:30.899201 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-bfb4bad7-6d62-4567-9dc1-1702f99557c5 tempest-VolumesActionsTest-887473746 tempest-VolumesActionsTest-887473746-project] 10.222.0.65 "GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b" status: 404 len: 111 microversion: 2.1 time: 0.029218 May 10 03:27:30.899201 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 510/1040] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:30 2022] GET /compute/v2.1/servers/a546e10c-c501-4bd4-bcf4-701f007ffa8b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 03:27:31.578055 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:27:31.580981 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Tue May 10 03:27:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:27:31.685343 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-3a1e370f-4583-4e49-a68d-6bfd66f3ac13 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:31.685865 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-3a1e370f-4583-4e49-a68d-6bfd66f3ac13 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:31.692112 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3a1e370f-4583-4e49-a68d-6bfd66f3ac13 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:31.692565 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3a1e370f-4583-4e49-a68d-6bfd66f3ac13 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:31.693326 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3a1e370f-4583-4e49-a68d-6bfd66f3ac13 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:31.693755 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-3a1e370f-4583-4e49-a68d-6bfd66f3ac13 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:31.770043 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.objects.instance [None req-3a1e370f-4583-4e49-a68d-6bfd66f3ac13 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lazy-loading 'services' on Instance uuid 7d7937f8-db90-44e2-9495-9ccffbe717d2 {{(pid=117399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:27:32.004742 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-3a1e370f-4583-4e49-a68d-6bfd66f3ac13 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2/os-volume_attachments/1f5f65b6-4de4-40b2-a170-ed4c23927ffd" status: 202 len: 0 microversion: 2.1 time: 0.323599 May 10 03:27:32.005464 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 531/1041] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 10 03:27:31 2022] DELETE /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2/os-volume_attachments/1f5f65b6-4de4-40b2-a170-ed4c23927ffd => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 03:27:33.115451 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-574432f7-0b59-445d-a641-e89000326ddb tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:33.115960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-574432f7-0b59-445d-a641-e89000326ddb tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:33.123026 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-574432f7-0b59-445d-a641-e89000326ddb tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:33.123478 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-574432f7-0b59-445d-a641-e89000326ddb tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:33.124288 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-574432f7-0b59-445d-a641-e89000326ddb tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:33.124733 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-574432f7-0b59-445d-a641-e89000326ddb tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:33.151855 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-574432f7-0b59-445d-a641-e89000326ddb tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] Going to try to terminate instance {{(pid=117400) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 03:27:33.503858 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-574432f7-0b59-445d-a641-e89000326ddb tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2" status: 204 len: 0 microversion: 2.1 time: 0.391786 May 10 03:27:33.505328 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 511/1042] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 10 03:27:33 2022] DELETE /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 03:27:33.515219 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-ff942cf1-4a3b-4ca7-a175-cbe9d1b9a776 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:33.516110 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-ff942cf1-4a3b-4ca7-a175-cbe9d1b9a776 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:33.522887 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ff942cf1-4a3b-4ca7-a175-cbe9d1b9a776 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:33.523344 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ff942cf1-4a3b-4ca7-a175-cbe9d1b9a776 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:33.524330 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ff942cf1-4a3b-4ca7-a175-cbe9d1b9a776 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:33.525013 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-ff942cf1-4a3b-4ca7-a175-cbe9d1b9a776 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:33.675064 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-ff942cf1-4a3b-4ca7-a175-cbe9d1b9a776 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:33.684303 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-ff942cf1-4a3b-4ca7-a175-cbe9d1b9a776 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2" status: 200 len: 1515 microversion: 2.1 time: 0.174190 May 10 03:27:33.686270 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 532/1043] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:33 2022] GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 03:27:34.704738 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-b67f4c73-e5b9-4119-babe-03b93642bb09 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:34.706278 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-b67f4c73-e5b9-4119-babe-03b93642bb09 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:34.714107 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b67f4c73-e5b9-4119-babe-03b93642bb09 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:34.714767 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b67f4c73-e5b9-4119-babe-03b93642bb09 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:34.715703 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b67f4c73-e5b9-4119-babe-03b93642bb09 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:34.716866 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-b67f4c73-e5b9-4119-babe-03b93642bb09 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:34.864063 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-b67f4c73-e5b9-4119-babe-03b93642bb09 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:34.872098 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-b67f4c73-e5b9-4119-babe-03b93642bb09 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2" status: 200 len: 1515 microversion: 2.1 time: 0.172983 May 10 03:27:34.872854 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 512/1044] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:34 2022] GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:35.889076 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-89115440-50c8-4ab9-b3ef-419651388ae7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:35.889716 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-89115440-50c8-4ab9-b3ef-419651388ae7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:35.897404 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-89115440-50c8-4ab9-b3ef-419651388ae7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:35.897970 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-89115440-50c8-4ab9-b3ef-419651388ae7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:35.898824 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-89115440-50c8-4ab9-b3ef-419651388ae7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:35.899577 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-89115440-50c8-4ab9-b3ef-419651388ae7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:36.037046 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-89115440-50c8-4ab9-b3ef-419651388ae7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:36.046922 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-89115440-50c8-4ab9-b3ef-419651388ae7 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2" status: 200 len: 1515 microversion: 2.1 time: 0.161442 May 10 03:27:36.047518 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 533/1045] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:35 2022] GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:37.072846 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a38109fe-8ffc-4639-acdf-fdfac462f7ea tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:37.074193 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-a38109fe-8ffc-4639-acdf-fdfac462f7ea tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:37.086382 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a38109fe-8ffc-4639-acdf-fdfac462f7ea tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:37.086897 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a38109fe-8ffc-4639-acdf-fdfac462f7ea tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:37.088136 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a38109fe-8ffc-4639-acdf-fdfac462f7ea tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:37.088586 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a38109fe-8ffc-4639-acdf-fdfac462f7ea tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:37.247929 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.policy [None req-a38109fe-8ffc-4639-acdf-fdfac462f7ea tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117400) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:37.265023 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-a38109fe-8ffc-4639-acdf-fdfac462f7ea tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2" status: 200 len: 1515 microversion: 2.1 time: 0.204762 May 10 03:27:37.266010 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 513/1046] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:37 2022] GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2 => generated 1515 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:38.290653 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-e303030c-2ad6-4fed-8244-cb0c58bd7131 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:38.291966 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-e303030c-2ad6-4fed-8244-cb0c58bd7131 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:38.306764 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e303030c-2ad6-4fed-8244-cb0c58bd7131 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:38.309644 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e303030c-2ad6-4fed-8244-cb0c58bd7131 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:38.311214 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e303030c-2ad6-4fed-8244-cb0c58bd7131 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:38.316470 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-e303030c-2ad6-4fed-8244-cb0c58bd7131 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:38.460744 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-e303030c-2ad6-4fed-8244-cb0c58bd7131 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:38.469810 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-e303030c-2ad6-4fed-8244-cb0c58bd7131 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2" status: 200 len: 1515 microversion: 2.1 time: 0.190272 May 10 03:27:38.483094 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 534/1047] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:38 2022] GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2 => generated 1515 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:38.584711 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [req-665cebdb-bfad-4059-904b-0eb120c97ef9 req-cce52550-83f2-4590-a291-9d5adcbef73d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7937f8-db90-44e2-9495-9ccffbe717d2", "name": "network-vif-deleted", "tag": "e2732a60-6e91-4621-a5bb-e288ab297bfa"}]} {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 03:27:38.595641 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-665cebdb-bfad-4059-904b-0eb120c97ef9 req-cce52550-83f2-4590-a291-9d5adcbef73d service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:38.596359 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [req-665cebdb-bfad-4059-904b-0eb120c97ef9 req-cce52550-83f2-4590-a291-9d5adcbef73d service nova] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:38.610378 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.compute.server_external_events [req-665cebdb-bfad-4059-904b-0eb120c97ef9 req-cce52550-83f2-4590-a291-9d5adcbef73d service nova] Creating event network-vif-deleted:e2732a60-6e91-4621-a5bb-e288ab297bfa for instance 7d7937f8-db90-44e2-9495-9ccffbe717d2 on hv-cinder-83009 May 10 03:27:38.616192 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [req-665cebdb-bfad-4059-904b-0eb120c97ef9 req-cce52550-83f2-4590-a291-9d5adcbef73d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035676 May 10 03:27:38.616868 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 514/1048] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 10 03:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 03:27:39.487614 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.api.openstack.wsgi [None req-4f6c2069-2295-4092-9c97-fada680d996a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:39.488420 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.compute.api [None req-4f6c2069-2295-4092-9c97-fada680d996a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] Fetching instance by UUID {{(pid=117399) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:39.501990 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4f6c2069-2295-4092-9c97-fada680d996a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:39.502655 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4f6c2069-2295-4092-9c97-fada680d996a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:39.503911 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4f6c2069-2295-4092-9c97-fada680d996a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:39.504540 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4f6c2069-2295-4092-9c97-fada680d996a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:39.539011 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4f6c2069-2295-4092-9c97-fada680d996a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:39.539821 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG oslo_concurrency.lockutils [None req-4f6c2069-2295-4092-9c97-fada680d996a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:39.540482 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.objects.instance [None req-4f6c2069-2295-4092-9c97-fada680d996a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lazy-loading 'fault' on Instance uuid 7d7937f8-db90-44e2-9495-9ccffbe717d2 {{(pid=117399) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 03:27:39.599954 dv-cinder-830094-4-smb devstack@n-api.service[117399]: DEBUG nova.policy [None req-4f6c2069-2295-4092-9c97-fada680d996a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43ec3800caa42ed9a4fcf3405ef3d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3186bec57c94e2f84ae52cae506dbc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117399) authorize /opt/stack/nova/nova/policy.py:199}} May 10 03:27:39.609513 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO nova.api.openstack.requestlog [None req-4f6c2069-2295-4092-9c97-fada680d996a tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2" status: 200 len: 1309 microversion: 2.1 time: 0.126679 May 10 03:27:39.610389 dv-cinder-830094-4-smb devstack@n-api.service[117399]: [pid: 117399|app: 0|req: 535/1049] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:39 2022] GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2 => generated 1309 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 03:27:40.628798 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a2e67e56-ec58-4c7b-9d44-d11917a3ce48 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Calling method '>' {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 03:27:40.629529 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.compute.api [None req-a2e67e56-ec58-4c7b-9d44-d11917a3ce48 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] [instance: 7d7937f8-db90-44e2-9495-9ccffbe717d2] Fetching instance by UUID {{(pid=117400) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 03:27:40.636681 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a2e67e56-ec58-4c7b-9d44-d11917a3ce48 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:40.637505 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a2e67e56-ec58-4c7b-9d44-d11917a3ce48 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:40.638438 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a2e67e56-ec58-4c7b-9d44-d11917a3ce48 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 03:27:40.639634 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG oslo_concurrency.lockutils [None req-a2e67e56-ec58-4c7b-9d44-d11917a3ce48 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Lock "e40af967-83ea-437d-8987-bd41fe271b3a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 03:27:40.653739 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.wsgi [None req-a2e67e56-ec58-4c7b-9d44-d11917a3ce48 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] HTTP exception thrown: Instance 7d7937f8-db90-44e2-9495-9ccffbe717d2 could not be found. May 10 03:27:40.655523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a2e67e56-ec58-4c7b-9d44-d11917a3ce48 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Request method failure captured: May 10 03:27:40.655523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: request: GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2 HTTP/1.1 May 10 03:27:40.655523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept: application/json May 10 03:27:40.655523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Accept-Encoding: identity May 10 03:27:40.655523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Connection: close May 10 03:27:40.655523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Length: 0 May 10 03:27:40.655523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Content-Type: application/json May 10 03:27:40.655523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Host: 10.222.0.65 May 10 03:27:40.655523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Openstack-System-Scope: None May 10 03:27:40.655523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: User-Agent: python-urllib3/1.26.9 May 10 03:27:40.655523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Auth-Token: gAAAAABieds9ol3X8CaKqqw5bNezJOsQvEgovlNQQN4dDPIPG-G-8uXU6JKCWfjZl7v1pyPAxn0n2pKjYtyjMGtSLknFIWizJ66ZnxF63MQxAvaXG3HVyGzdNO6uh16URjPReiGFwsV7-1N4Xqa-Uogm0GrKj6819Z4d0--QCS6hja2IsowL6WI May 10 03:27:40.655523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Id: None May 10 03:27:40.655523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Domain-Name: None May 10 03:27:40.655523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Identity-Status: Confirmed May 10 03:27:40.655523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Is-Admin-Project: True May 10 03:27:40.655523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Id: default May 10 03:27:40.655523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Domain-Name: Default May 10 03:27:40.655523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Id: f3186bec57c94e2f84ae52cae506dbc2 May 10 03:27:40.655523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1430955927 May 10 03:27:40.655523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Role: reader,member May 10 03:27:40.655523 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Roles: reader,member May 10 03:27:40.656977 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f3186bec57c94e2f84ae52cae506dbc2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f3186bec57c94e2f84ae52cae506dbc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f3186bec57c94e2f84ae52cae506dbc2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f3186bec57c94e2f84ae52cae506dbc2"}]}] May 10 03:27:40.656977 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant: tempest-VolumesSnapshotTestJSON-1430955927 May 10 03:27:40.656977 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Id: f3186bec57c94e2f84ae52cae506dbc2 May 10 03:27:40.656977 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1430955927 May 10 03:27:40.656977 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User: tempest-VolumesSnapshotTestJSON-1430955927-project May 10 03:27:40.656977 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Id: default May 10 03:27:40.656977 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Domain-Name: Default May 10 03:27:40.656977 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Id: f43ec3800caa42ed9a4fcf3405ef3d5e May 10 03:27:40.656977 dv-cinder-830094-4-smb devstack@n-api.service[117400]: X-User-Name: tempest-VolumesSnapshotTestJSON-1430955927-project May 10 03:27:40.656977 dv-cinder-830094-4-smb devstack@n-api.service[117400]: method: > May 10 03:27:40.656977 dv-cinder-830094-4-smb devstack@n-api.service[117400]: exception: Instance 7d7937f8-db90-44e2-9495-9ccffbe717d2 could not be found. May 10 03:27:40.656977 dv-cinder-830094-4-smb devstack@n-api.service[117400]: action_args: {'id': '7d7937f8-db90-44e2-9495-9ccffbe717d2'} May 10 03:27:40.657747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: {{(pid=117400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 03:27:40.657747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:27:40.657747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 03:27:40.657747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 03:27:40.657747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 03:27:40.657747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 03:27:40.657747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 03:27:40.657747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 03:27:40.657747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 03:27:40.657747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 03:27:40.657747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7937f8-db90-44e2-9495-9ccffbe717d2 could not be found. May 10 03:27:40.657747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:27:40.657747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:27:40.657747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:27:40.657747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:27:40.657747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:27:40.657747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:27:40.657747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 03:27:40.657747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 03:27:40.657747 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 03:27:40.658960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 03:27:40.658960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 03:27:40.658960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 03:27:40.658960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 03:27:40.658960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 03:27:40.658960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 03:27:40.658960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 03:27:40.658960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7937f8-db90-44e2-9495-9ccffbe717d2 could not be found. May 10 03:27:40.658960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:27:40.658960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 03:27:40.658960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:27:40.658960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 03:27:40.658960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 03:27:40.658960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 03:27:40.658960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 03:27:40.658960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 03:27:40.658960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7937f8-db90-44e2-9495-9ccffbe717d2 could not be found. May 10 03:27:40.658960 dv-cinder-830094-4-smb devstack@n-api.service[117400]: ERROR nova.api.openstack.wsgi May 10 03:27:40.660105 dv-cinder-830094-4-smb devstack@n-api.service[117400]: DEBUG nova.api.openstack.wsgi [None req-a2e67e56-ec58-4c7b-9d44-d11917a3ce48 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] Returning 404 to user: Instance 7d7937f8-db90-44e2-9495-9ccffbe717d2 could not be found. {{(pid=117400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 03:27:40.660105 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO nova.api.openstack.requestlog [None req-a2e67e56-ec58-4c7b-9d44-d11917a3ce48 tempest-VolumesSnapshotTestJSON-1430955927 tempest-VolumesSnapshotTestJSON-1430955927-project] 10.222.0.65 "GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2" status: 404 len: 111 microversion: 2.1 time: 0.033832 May 10 03:27:40.660105 dv-cinder-830094-4-smb devstack@n-api.service[117400]: [pid: 117400|app: 0|req: 515/1050] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 10 03:27:40 2022] GET /compute/v2.1/servers/7d7937f8-db90-44e2-9495-9ccffbe717d2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 03:29:14.945858 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:29:14.987295 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Tue May 10 03:29:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:30:51.586701 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:30:51.587335 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Tue May 10 03:30:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:32:19.886322 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:32:19.887147 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Tue May 10 03:32:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:32:34.954390 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:32:34.955013 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Tue May 10 03:32:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:32:40.788407 dv-cinder-830094-4-smb devstack@n-api.service[117399]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:32:40.788944 dv-cinder-830094-4-smb devstack@n-api.service[117399]: Tue May 10 03:32:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:32:44.387019 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:32:44.387517 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Tue May 10 03:32:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 03:32:51.564716 dv-cinder-830094-4-smb devstack@n-api.service[117400]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 03:32:51.565313 dv-cinder-830094-4-smb devstack@n-api.service[117400]: Tue May 10 03:32:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!